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. Thill rupor^t lont.iinri \nn\\ ilata ami opinions. . Tl»«? oplnlunti. M 
« • 
courii«. Are my own. But I could ni^vtir hnvti lollrrtfa tlic lUtn or 

> 
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rRuch Hasrfaneln worktHl wlth me L nearly allyphnae/of the anulyHls. 
aupefvlalng the necessary computer work, assisting With the. Inter- 
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data, outcome and Implicat'lons , always striving for 80ui4 analys Is . ■ 
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a 40-author of this report. » . . 

. I am indebted CO the Institute for Community Studies for 
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. Dr. Robert Barnes; an originator of; the project, helped/with back- 
ground, and as Acting Dlreptor of, the Epidemiologic Field Station 
for Mental Health and Executive of the Greater Kansas City Mental 
Health Foundation hired me as a. senior" research associate and 
designated me to carry pn' t;he -follow up of the proj^t at the Field 
Stat'lcjn. When I joined the Department of Human Ecology and 
Community Health at the K.U. Medical School^ the. Foundatlonjreleased 
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. 'introduction 



- ■ - ;'?rbe. Joint Commission dn the Mental Health of Children and Youth 
suggested th^t we have , in our qgtion aicfne> 95;aOO,Oda children in, 
need of remedial help. If public ^chool 'teachers can *e t:a,ught the 
^K^sas-^City way , we 'may>:be.. ablB to re*ach..f significant portion of 

those children,, arid prevent others ^rom becoming "problem" statistics. 

' ■ * ' ' * . ^ ■ . * '■ 

The Kansas City School Behavior Project was ^intende.d to devise ; 
.and test the effectiveness of a program of action* for ^the treatment 
:o£.mild behavioral disturbances in children in the schpol setting. 
The program was expect eci to prevent, to some e>ctent , sevete behavioral 
dts^rbances among these children in the adolescent years, and to 

have an> effect on behavior in the total community as well W in the 

' . . , . , ~ ^ ' \ ", \- 

school setting. The design wp executed' within the resources of ^ 
personnel a|id time budget of the regular school system. The project^ 
was intended to be a pilot demonstration — a model for other.^chools 
and other communities. ' . ^ ^ 

Early follow up of the pupils in the project Indicated th^t 
there might be positive results for one sooio-ecpnomic segment three 
years after the experiment took place. This pattern of -differences 
was observed in referrals, suspensions, absence rates and teact^gr 
ratings'. : After six years of' intensive effort the payoff appeared 
to be emerging fro^ the mountain of data which had been gathered. 
Wfe had to know If It was dependable, and whether it could be broadened 



to behavior outside the school systeia. We felt we Jiad to know what - ^ 
the conditions were under which it ;/or-ked or failed to work.^' 
proposed an epidemiologic follow up, for the one socio-^copomic 
."segment of the original • project whfch was then funded ^-the'NIMH 
Center for Ep.idemiologic Studies. 

Oar strategy for the analysis was: 1) to test" again for positive 
or negative outcome, with emphasis on the ninth grade year, but also 
checking for earlier f inding^iwhich might tie ^outcome more closely to 

intervention; 2) to test whether the apparent ninth grade year finding 
' ' ' * ' ' i 

could be shown to persist into 'the following two grade^ears; 3) to 

test whether this apparent prevention effect coul^ be'^uttressed with 
data from outside the school sy^em, gi^^in^t both greater credehce ^ 
and value; and 4) to attempt to specify" epidemiologic conditions under 
which the prevention effect was valid or invalid, or was more or less 
pronounced. If the data produced answers in these areas, we ^ ^It we 
could reasonably make recommendations for the design of future inter- 
vention efforts for the health of children and youth consistent with 
our findings and our understanding of the relationships among the 
important factors delimited in our analysis. , 

Our attempt <.tb answer these questions required data collection: 
"".1) of absence rates, teacher ratings and family, file referra^ls for 
behavior problems for two further school years , extending the time 
of the follow up to five years, or the eleventh grade year; and 2) 
police records and juvenile court records for the entire life of fach 



child in the socio-economic cohort up /to and including the eleventh * 
grade year* Many other indicators i^ight have been used^ Our concern 
was that we> duplicate the earliep?^ata on a longer time line, and that 
we utilize real-life variables ;/^ecords which are kept as an ordinary 
process, not conjured up for bur benefit, and* records which are 
consequential in the lives/of children in their communities. 

In order to give the most conservative answer to these questip^ 
we assumed the null hypothesis, pooled the experimental and control 
.group frequencies, ^nd compared the experimental condition with the 

(pooled) expected/ frequencies. - We also made the standard experimental/ 

^ ■ = . / , • .'. ' 

control comparisons characteristic By characteristic, for investi- 

gators more familiar with that process and its outcome properties.^ 

Processing the data from previous follow up investigations, and 
some new data from our search indicated that the Experimental and 
Cotitrpl groups were indeed comparable. Differences in the outcome 
charts should not be attributed to loss in follow up, or dropping 
out, or social and economic differences. Loss rates were well within 
acceptable limits (less than 10% over five years) and a review of-the 
characteristics of remaining pupils does not suggest any special 
bias. There were no statistically significant differences in 
dropping out, in the Experi^ntal and Control comparisons. The 
neighborhoods the elementarjir) schools served were carefully matched 
for socio-economic status. All neighborhoods involved were in one 
socio-economic category, the lowest in Warners five category break- 
down. Bussing, had not yet begun. Stanf ord-Binet scores produced 



means for the two groups within .3 of each other, behavior, problem 
data recorded in the sthobla, Juvenile .court afid the police £il#s. 



if anything, favored the Control conditioti. 



Early analysis for* comparability, of the Experimental and' Control 
groups suggested three epidemi\logic variables jwhich*mi^ht affect 
outcome: .1) sex, 2) race, or ethnic identification' and 3) later 
school envii;onments in junior rand"^ senior high. The experiment took 
place in sixth grade. From there^ -most students went on to junior 
highs, scattering somewhat in* the various schools in their part- of 
the school district. *, ^ 




RELATED EPIDEMIOLOGIC. STUDIES ^WwlLE DELIlfQUENCY 



Epidemioiogy is a study of relative risks. The epidemiologist 
estimates the risk of the appearance of a condition in one population 
group and compares this' risk w^itli that for another group. The risk 
can be expressed as the proportion of the total pcTpiilation group who^ 
actually,.^^t the condition. The estimate of risk requires two numbers 
the nupber of people; in the total population, and the number who' had 
the condition. 

For study purposes, group's may be formulated in various ways: 
for instance, ^^5tfle living in ^certain areas or people of different- 
ages or races. If the right groups are chosen, a comparison will 
show which people are most vulnerable to a condi^tion. Finding out 
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why these particular people ar^ so vulnerably should lead to^ better 
methods of control, • * , 

Epic^emio logic methods are as well adapted to the study of 
•behavior, problems as to the study of cholera. Behavior problems. are 
distributed unevenly in the^ cpramunity> ^nd appear to be related to , . 
both social and personal influences, ^^dividuals are not equally 
gus^^l^ble to those influences/ " , 

' 'The risk^Qf delinquency, if ' we can Call that, may be defined 
as the number of individuals in a particular classification who 
become delinquent out of -each thousand in a particular claissif ication. 
Mathematicap-ly, this is^a^ problem of division: Risk equals delinquents 
divided by population. The result is ^^en multiplied by lOOO to 

convert it to rate per 1000 at risk, '^^is to calculate risk we need 

* ' • # ' . , , ' ■. 

to know only the. ntlmbeic^ of people of tne same type who might have 

become delinc^uent. When the popu^^ti^n is divided in complex ways?, 
such as by sex:,i age, and race simultaneously^ it. may be difficult to 
determine both the numerator and the denominator*^ 

Three major studies of delinquency have been made by epidemio- 
logic methods. In 1961, J. W. Eaton and K. Vol^i published a study of 
'the delinquent juveniles of Lo§' Angeles . ^ 1953, S.R. Hathaway 
and E.E. Monachesi, in a study of adolescent personality, related 
juvenile delinquency in their study P^P^^ation to their entire ^ 
group pf subl^cts . . In 1969 ,>V. Eisner PUblistigd his study San 
Francisco delinquents, focussing on the signjf j;cance of* labeling,, and 



the possibility that the correlat;fon of delinquency wi;,th race tnight 

y - 



not be Indepena^t of such otheiE^tor? as income , pl^cp op resid 



ence 



and family structure. 



! 



Eaton and Polk dealfexw^"^^ Probation Department reccjrd^ for. 1956. 

fhev looked at the effecW on delinquency of agi, sex, dttjic group, 

! J : I. ■ ' 

marital 'status pf parents, and geographical mobility. | T^^ftej showed 
rates for" boys as four times greater than those f or^I-^lls • Minority 
group .membership was significant. Negro and M^Ican'^mirjorJ ties had 
far higher rate's ^ than the "white majoT-ityr Japanese rat4s-|er.e lowest 
of all. Other data -seemed to offer an ^piapation: cfe'jldren from 



broken homes had an incWed risk of delinquency, and |:he[ Japanese 
group had fewer broken h'omes. The Eaton and Polk -study al.feo showed 
that recorded rates of recidivism Vrflected administrative pro- 
' cedure far^re than, they reflected* actual delinqtlfencies . 
Geographfcal mobility did not seem to Influence:, rafes to any great, 
extent. Eaton and Polk' suggested control measures ^be aimed at . 
increasing family stability. HalUj^way and Monachesi .studied ninth 
grade white children to whom they gave the~M.M.P.J^, and followed 
them for three to four^ years. They divided their population by age, 
size of community, father's occupation, type, of family and 
intelligence of the child. They found delinquency rates decreased 
as their subjects reached -nineteen years of ag?, varied inversely 
with socJ.o^economic status, and were higher for. children with ^ . 
broken homes. <^ Rates did not vary with intelligence, but did vary- 
inversely with high .school rank. They also varied with population 



density, .which the investigators related to occupation, as rates were 

) J ■ < - ' ■ r 

very ,low for' children of farmers. Hathaway and Monachesi also , 

.pointed out certaii^personalit'y types who were liable to become 
delinquent . . , * « , 

i ■ ■ , ? ■ 

Eisner; in a sophisticated factor analysis, found that four 
major eleie^xts were necessary to predict delinquency rates: 1) sex, 
2) rade, 3) economic conditions and 4) intraf amilial conditions. -In • 
or4er to explain all the variations In rates it was necessary to add 



thte differrac^s ' in behavior that characterize' racial "gi^s. 
■ ' Eisner tested the -possibility that number of parentJin the home / 
was the main factor explaining variations in delinquency rates, by 
equalizing his^other factors. Delinquency rates were higher for bpth 
^^^8 In homes"^wlth'less than two parents, except in the lowest 
income . quart lie non-white boys, , where the rate was higher where ^ 
there were .two parents in 'the heme. Further analysis indicated" this 
finding might be related more properly^ to; certain le^el^ of low income 

invUhe Negro population only. , 

. ■ '' ► ' I 

-i^^ur own research deals ^th a^ population defiirtfd ^somewhat as 

thatVof the Hathaway and Monachesi study: children who had teen 

part of an educational experiment, and their control , population, ^t^'"^ 

. ■ . ^' > /i . ^ 

has, however, sbmewhat the geographic base of Eisners census tract 
stnd^ iii that the children are from knowh neigbbqrhoods , in a 
'XsingleTcore city btrf^ in^ sixth grade classrooms miftched for soclo- 
econoi/ic status. A random assignment of classrooms/ to the.^e3^i)erimental - 



and control conditions Should randomize such vai:lables' as sex, 
ethnic group, geographical mobility, marital status of parents ani 
father's occupation, and tend to equalize any remaining econom^ 
conditions and age which have oeen shown to affect problem 



behavior rates 



This randomization and equalization of variables shown previously 
to be important in the development of problem behavior should permit 
ua^to determine the effect of the experiment on such behavior. 



' ^ "The Youth Development Project In Kansas City was an experiment 
performfed in 1963 in the public schools to enft^nce the social'^ 

emotional^ development of individual pupils. The Project was originally 

^ . > * - ' • 

directed .by Dr. Robert Barnes, then Executive Director of the Greater 

Kansas City Mental Health Fouadation, wlthj^He assistance o£ < 

TJiomks S. McPartland, Ph.D., and George J. Lyttoif, M.D. Dr^ Paul Bowman 

now Director of * the' ^nstitute for Community Studies in Kansas City, 

was brought to Kansas City to head the project, and carried the major v» 

administrative load.. Many other people have been substantially 



involved in the project. ^Dr. Oren Click, during his years at the 
Institute for Community Studies, was responsible for the analysis 
which produjced' the posit^ finding at t^ie close of the grant period 



Grants were held first by the Foundation (MH 0535) and then trans- Z^' 
f erred to the Institute (Rll MH 2303) j and ended in December 1966. 
The Kansas City' School District also held a grant dealing with this 
project, MH 02041, during the same period. ^ 

The project origiaated in the concerns, of educators- over the^^ 
apparently grdfwl^g problem of behavioral disturbances in the schools, 
A committee composed of r'epresentatives of The Kansas City, Missouri ' 
School^lMstricj:, The Greater Kansas City Mental Health Foundation, : 
and tfie School of Education at the University of Missouri at 
Columbia met periodically for a number of months to explore tp^- 
gather the nature of the problem and to develop ideas for action 



programs designed to alleviate 'the"^ problem. The work of this -committee 
culmina'teavtn^ action-researcH proposal that was funded, as d^escribed 
abov^, by the NAtijanal Institute' of Mental Health. 

The Kansas City Project wds related in certain respects to the 
Ullman ^Study\lpman. 1952) ; The Quincy Youth Development Proj^.t in 
Illinois <BowmJL, 1956")," the Men^l Health ResearcIr-f?a;ogram of the 
St, Louis Count\ Health Department' in Missouri (Glidewell, 1957, 1959), 
Tlife Human RelWons Program of the University of Iowa (Ojemann, 1955), 
aid the Cambridge-Somerville Study (Powers and Witmer, 1951), 

wAich preceeded it in point of time. The reliability and predictive 
value of teacher ratings, the usefulness of several test instruments, 
kno^edge about appropriate sequence and timing decisions, successful 
training program practices, and. the necessity of . pre-plann^a evaluation 
including control .groups were some of the el^ents of these studies 
or their findings built into the Youth Development Project in Kansas 

■City. , ..... • ;^ ; ■ . . • 

The. impetus for the project thus derived from' difficulties posed 
for the schools, and eventually for society generally, by pupils who, 
for one reason or another, did not function successfully or satis- 
factorily with their fellow human beings.. Efforts to sol^i these 
problems through clinical service arrangements with thej^iundation 
had proven that solution was inadequate to the need. It w^rTrteraily 
^. IjBpossible to give individual treatmeift to all children needing it., 
it was felt that any lo'ng range solution would, require extensive , 



effort on prevention o£ such problems^ rather than on treatment at a 
more serious stage. Such efforts, it was thought, might best be 
expended pn the (Jeveloptoent of. certain classroom, methods and tech- 
niqvies in: whi^h teachers could be tfrained. These methods and 
techniques would be aimed toward producing learning co^diti^^ in the 
classroom which would be more emoticn^ally healthful for. all children, 
and wh$$:h nji;ght ^hereby 'prevent the mildly disturbed chdld from getting 
to be* a more serious problem. ' ^ , 

0 • Thj^ best ac.count, of the content of the training is- contained 
in two published bullatl.ns ( A Teacher Training Program in Classroom 
Rental Health , 1964, The- Use of Small Groups in the Classroom , 1964). 
Teac'hers in til>e experiment were regular clAjs^room sixth grade „ 

•* • . - •- ' . * <■ »i . ' 

teachers in' the karjsas City Scttool System. Sixty teachers' were 
selected\/rom a pool .of . 9,0 volunteers . All socio-economic status 
levei^^ were initially represented bul^ representation at the highest 
levels was meager and the loss of several pegchers. eliminated 



expierimental-control comparisons at the two highest levels of^the 
five defined for the stUjdy.VThe classrooms, with their teachers 
were divided Hnto two groups with rough matching of four variables: . 
the "socio-economic level of the neigl^borhood served by the school, 
and the 'sex-, teaching competence as judged by the school administra- 
tion, and years of teaching exper^^ce represented the teacher 
con One group served as the exper^jnental group, and the other 

the control. The experimental teachers received the special 



training described above, In a summer work shop, and were given 
support throughout the experimental year. 

Tne evaluJ^i,on wds completed, within the limitations of the grant 
and Included, in addition tia many measures intended to investigate . 

attitudioal and scholastic outcomes during the year of the experiment, 

I ■ 

• / * ' » . , ■ — 

certain *follow up* data, collected f or ,tTie three years . after ^the 

experii^ejj;t , tr^acing the progress ^'of tjfe children in grades seven, 

eight amf nine. Teacher rating^s, absences ,» and cent^raL off ice family. 

file recor^ls showed^ the children in the experiment, from the lowest 

. - , ' r ■ ' \ 

socio-economic neighborhoods, superior to children^^in the matching 

control group, at the ninth grade. 

f ^ * • 

. V* ' • ' , 

The value of demonstrating a solid evaluation of one such program 
should be clear. Further data was gathered at the NIMH Epidemiologic 
Field Station and then application was made to the Center for 



Epidemiologic Studies for funds to complete the follow up, resulting 
In grant ifl ROl MH 20594-01, "An Epidemiolo^c Follow Up of a Cohort 
of School* Children, jind this report. ^ 

REMAPS: BAC'KGROUNd'aND SIGNIFICANCE^ 



As Dr. Barnes pointed out in a presentation to the KU Roots of 
Responsibility Workshop earlier this fall^ the Kansas City School 
Behavior Project is (or wa^s) the sort of project which'^11. never be 
done again, '^t will no,t be doneragaih for -d itumber ' of rejasqns, not 

• ■ . . •- '■. ' . • ■ ' ^ 7 . 

the least of which is that it represents one, of t1iq.se JLong'^term , 
exp^nslj/e projects which are no longer in vogue. Curxent economic 



analyses suggest they never be funded or carried out i4i the 

future* *T^t is one .reason to mine the dat'a Q^arefulXy and report 

any f intiings as Wtensiviely as possible. Another reason to present 

\ ' ' ^ • • ] • . ••' ^ * • 

it is. to indicate. the importance long term follov up if we are 

interested in and concerned about social and educational change* 

project's, or projects which lead toward change. A third reason/ and 

perhaps th^ most important -hi^&-^(«nd our) point of view is that 

''there are <)as^p€C|;s of this project which are quite applicable' to most 

school systems, and which reprresent techniques ^nd approaches which 

can stil| be used very ef tectlvely without any significant exp'enditun 

of f\^nds.*' This was an experimental project and there was a tremen- . 

dous amount of research effort involved because of that. This part 

of the project is not necessary to the.^operational aspects of the 

ini^ervention. ' ' ^ ' 

When we went into. the Youth Development Project we weren't 
tH^nking longitudinally to any extent. Only as things developed ^pd 
we'eot intto the evaluation and saw what we didn't find and had hoped' 
to find did wa see the necessity of the long term follow up. 

The Mental Health Foundation was founded in Kansas City in 1952% 
It^was from the oi^tset, a rather interesting and unique organization. 
Among other things, it set up probably the first prototypical 
comprehensive community mental health center in the United States., - 
It was one of two major projects for many many years of the Kansas 
City Association and Trust Foundation. . The Institute for Community 



Studio's was thi^ other. Honor Wadsworth, at fifhat time president of 

Kansas City Missouri School Board,. came to the Mental Health* 
Foundation and asked if phere ybuld *any way mental health people 
could do some prevention, instead of bragging about what wa^ possible. 
He offered vis $25,000. to get upNout of our chairs and help the 
school system work something out. As the new Director, I couldn^t 
Bay no to a $25,600 offer: We toctk the money in good f&ith, filing 
that we womid undoubtedly wipe out future emotional problems and 
maybe even physical p^oblems^or the 80,000 or so inner city school 
children of;that time. Things got tough af ter that. 

The grant: was made with the cl^ar cut idea that we work out somethi 
mutud^ly agreeable and cooperative. Major planning was done with and 
by the top peo^)le ■ in the school district and the mental health 
foundation: the Superintendent of schools Jim Hazlett, Assistant 
Superintendent, Arthur Gilbert, Louise Zimmer, Supery.isor of 
Elementary Education, and the Director of Pupil Services, Bob MacNeven 
from the schools, ^nd top people in general psychiatry,, thild ^ 
psychiatry, administration and research from the foundatio^n. The 
school people were very problem oriented,' wanting something to help^f S^" 



the classroom teacher with the severe behavioral problems exhlbjLted 
by the school children, and which were becoming , mo re "and more over -» 
whelming to the teachers. At this time, 1958 and ^^959, integratioj^ 
was about five years old, and the beginning of the movement of the 
white population out of th:e district was apparent The mental health 
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prof esslonals wanted to concentrate on prevention. Their model, from" 
the public l^^lth 'standpoint, was that of primary prevention, while 
^tiiie. school people were feeling pressed at the secondary or tertiary 
level. After six months of sparring, position pkpers and excellent ^ 
discussions, often joined by Mr. Wad^brth, the schaol people won. 
I think that I have subsequently felt that was entirely rl'ght and ^ 
■• .proper.-': ' , . ' ' / * " 

The ^hopl people felt the proper point 'of 'entry was the junior 
high school. They said "That's where we really worry about him, and 
where he really gets out of control. (Outcome data later confirmed^ 
that prQblem counts at least for the SES V ch^lldren, rise sharply 
after seventh grade). They* were willing to co^^^wnlse with the. * 
mei\tal health staff's interest in starting with the younger children - 
and we settled on a focus at the sixth grade level^ 

Once we agreed on a grade level, we had to tackle, the^, questions 
of operational approach and evaluation. We had agreed on over all 
objectives: to develop' an approach to • the managements^of the^mlldly ^ 
to moderately disturbed by the ^school teacher in he^ own' classroom". 
We were trying to get away from referrals to the Child Research j 

Council, Child Guidance Clinic, -private psychiatirists'^nd even 

• ■ - ; ' ^ . • • ' ^ ' >^ .'^ 

schobl psychologists — to develop Within thei Classroom teaqher the ; 

skills to manage the problems within .t;heir own classrooms unless x 

they were severe disturbances or severe learning problems* 

We tried to keep our focus so that we developed a program 

operationally that the teacher would not see as interfering with her 



27 



educational efforts. In general, the techniques invo,lved includecf 

the efitire classroom at times, and at other times breaking the class 

* ' ^ ■ 

down into a number of -smaller work groups. 

,^ . . , • * • 

; ^/ Qne majtfr disagreement in the process of research design dealt 

,■ . • ' ' . 

With the extent to which' we could judge success in terns of outcome 
studies of the children. Some thought we should confine bur studies 
to the teachers attitudes and behavior. We invested considerable time 
and effort in the analysis of individual students cumulative case 
cards as a document for research purposes. This an^ other preliminary 
activities exhausted our initial funds, and a year and a half of our 
time. ' ■ ■ » ■ 

We brought the ilational Institute of Mental Health in<o our 
planning process, very actively, working with Dr. William Hollister 
who was at that ttime pmM.D. psychoanalyst on the staff in Washington, 
and interested ;La...the kinds of preventive work we now associate with 
Dr. Will Edgerton at Chapel Hill. The final outcome was a successful 
research . grant\^^^icatioT\. ^-Funding involved two years of actual 
demonstration - three yearfe of evaluation and follow up.* The 
projecfcwas funded as of July 1, 1962. I was the first director, 
with tfhe very capable assistance of Dr. Robert MacNeven" of the 

schQpl di^strict. Dr. Paul Bowmah, from- the DeKaljb Youth^evelop- 

< * * ' ' ' *'■ r-*^ ' ' ■ • 

ment JProject; joined ,us»as director a Jfew months later. 

We anticipat^ dealing with approximately 3600 students the 

first year, which will -give you some idea of the problems we were 

dealing with, the numbers of teachers, etc. A . tremendous amount 
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of data was generate4« Most of thq data was not totally analyzed. 

The only consistent finding was forlpupHs In the lowest socl9-^conomlc 

• level, in favor. of the experiment / for boys in the ninth grade year. 
This was the initial finding, anti the one which motivated the long- 
term' follow up. ^ ^ 

In the long term^ follow up we' dealt only with this lowest socio- 
economic group. It was not' just a small proportion of the sampLe. 
It was a significant portion ot the sample, and the group which was 
causing the most concern amongf the school personnel^. It was the ^ 
group dropping *out; specially the lower cl^ss male child, as he 
moved into adolescence. These findings may also be of particular 
interest to the court, <C^^* 

There seemed to be no possibility of following up beyond the 
ninth grade since funds had run out-by this time, and the Vietnamese 
war was heating up, the great society was beginning to make less 
and less funds available for behavioral science research. At this 
pQint in time, NIMH d^^ed to. set up a series of epidemiologic 
field stations around the country and we were one of the places they 
negotiated with. As it turned out, we had the only one they ever 

' established. "^The Field Station wa^ operated. as a contract with the 
Mental Health Foundation^- and in the process of getting it operational, 
I w4s-.,th;e original director. We developed .a number of projects. ^ 
One of "tSm was the follow up of the apparently positive findings 
of the Kansas City Youth Development Project One of the people we 
hired was Dr. Hartley ,L^nd this b^caiffe her responsibility, ^so that 



ERIC 



-21- 



.then we had the opportunity to follow th^se children after nii^th 

grade and in general to utilize the same pardijneters which had been . 

used^be'fore. This made possible a significant and crucial extension 

gindl three years and through the . >..r \ 

ve years beybnd the b^gitining of the 

experimental phase. ^- ; ^ ^ . * 

If became possible' for us to look at rather exciting preliminary 

^l^ings which indicated that by gosh YOU COULD DO SOMETHiNG ABOUT C!.» ' 

WHAT HAPPENS t6 A KID IN HIGH SCHOOL, IN TERMS OF SOCIAL BEHAVIQR, BY / 
I TEACHING CERTAIN SKILLS TO A SIXTH GRADE SCHOOL TEACHER. )This made^ . 

us very excited about the possibility of seeing if this indeed turned 

out to be true. ^v.^ 

[Principal Investigator Hartley described the majoi^ findings at this 



int in the Workshop. Presentation sent in ask' Report //3.] 



po 



Paul Bowman, whodirected the Kansas City Youth Development/ 

' \ ■ ■ 

School Behavior project from shortly after the driginal NIMH grant was made 
available through the three year follow up; now heads the Kansas City 
Inst^t\iteJ. f or Community Studieg. He reports, It's exciting jfor me, 
after theses years to see this kind of data^ on the theater screen and 
to realize that in spite of the f.irustrations we went thi^ough, we ^ 
can begin tc see some effective results of what we did." Let me just 



make a. few comments about what was actually done'\^j2h the teachers so 

\ ■ • A ^ 
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that you have some bac«kground on this, and then make some observatid"trD.. ' 

about it. 

\* ■■ 

We had about/ t.htir^tlJ^ teachers involved in the training program. 
The prbgram began with three weeks of training in August before the 
school year opened and thereaftet it was a period of 'two hours a 
week in which the teachers met as a total group avSA in small groups 
with staff as they developed ideas. It was a cafeteria approach, • 
getierali^v" ^ professionals said, in effect, 'Here's 

what we think wis have learned in the mentaJL health field. We are not 
educators, and we do not .know hov to apply thi^ Hrlpwledge in the 
classroom. That's where your expertise 'ctjmes in. It's up to you to 
try to take what we are talking about and": work out applications for 
i^ ;iii your clasaltpom. As yojx do t!>4», we will try to i^tp^^lde ^ ; 
assistance through staff and small group sessions weekly. Then'we 

, would lik^ to be. measuring what you do as well as its effect an the 

' ' ^ ■ ■ ^ ^ \ ' „/■ - ' ^ • 

* children.' Now that puts teachers, in a vetry difficult position. It 

says, 'You are the experimental change agents. > We are not providing 

yo]U a blue print of what to do.^ At the same time, we will b*fe^ 

/jfifeasurlng what you are doing.' About a third of the! teachers- were , 

very active implementing^ these new ideas , and Buctfessf uT by^ our - . • 

i ' ■ % . 

standards. Another third were partially successful, | and about a ^ 

third idfidn't 4p very much^ ' j " ' 

* " ^ - , ' ■ [ " 

Another problem we built in for teachers, without realizing it, 
was, that in our concern about ihvalidating the research results, we 



•asked the principals to stay out the rooms -and give the teachers 
their heads. That was fine for research, but it deprived the teachers 
of support Chat they were used to and needed. They had to get most 
of their support instead 'from Yearns of ,five or six^ teachers (the 
small groups) from various parts of the city who were working 
together on the, project. 

Onfe other comment I'd like to make relates somewhat to the charts 

^ urn ,1 

you've; seen pn the screen. The teachers in filling out cumulative • 
records in junior high and higli school, tended ^to remark either that': 
1) this is one of the easiest kids I've had to teach — ^ you simply 
present him ^something and l]e goes ahead and does ^t; or 2) this is 
one of the most difficult kids to' teach, you tell him something, 
and all he does is ask questions. I think some of that Hind of 
reaction is represented in the charts, in the data differences between 
scKools. % ■ ^ ^ , 

One of our people at the Institute for Community Studies searched 
through twenty-five years of educational researclf literature, con- 
cluding that repbrts of changing teachers attitudes were very mixed. 

We did not produce any evidence, that we changed*?!?^ teachers attitudeis 

/ \, ^ ' . ' ' . 

We^^were able to chdnge teacher's operations . This was quite clear. 

After some years of joint effort, we could suggest useful prot:edures, 

and teachers could adopt these operations quickly. If we had to 

depend on whether we had changed at^tltudes, we would want ^'beg^off. 

■ . ' ' ■ ' i> . • . " , 

One other comment, about research design and carrying out 

projects^ ^ l' have participated in two ratljer long term projects, and ^ 



many short term* projects . T think we need to ^^■i^stlngulsh three major 
phases in a^iy project, short or long term: 1) The development of the 
program itself to' the poljit where it Is speclf.ic^ small, managable; 
land Where we 'can develop the program tjo the point that we are ready 
to tell other people about it before we get too itoany people involved ' ^ 

the front end. We ran into mos-t of our ^rouble beC£^use we were 
developing and implementing at the same time, and we were also 
'measuring both teachers and kids while it was developing; ^2) Program 
implementation; telling people about it, getting it inat^lled as 
effectively as possible^ into some sort of a social systemwhich has 
a*research -question, feedback to program people from the research, 
assistance to program people in establishing the program, 3^ Evaluating 
outcqpes and. impacts on individuals. Which is always the final test. • ^ 
If programs are to irivolvfe changing people \ni institutions, I 

think we have to think in terms of long years; oAly with long term 

^ _ ■ . - ^ / , 

research can we expect any real pay off. Willljam Glasser says you 

't ■ ' ^ 

'have to expect, thijee years for people to leaijy^ his 'program befdre 

^ \' 

you can begin evaluating it. In our project, t , think we would say 
three years is probably about right to develop a ^i^pgram, three years 
to install it) and then you need another three years to evaluate it." 

. -7" : ' ■ ^'^ 

[It has taken more like 12, this tiiA6. WSH.] 

Dr. Mary Meehan, former training consultant for the Kansas City 
Yputh lyevelopment/School Behavior project, and now in Research and 
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•^Development with the Kansaa^Clty School Dis^lct, remarked that she 
would like to add fourth phase to Paul's three phase plan. 'My.deep 
interest is in the improvement of the school district. After yoy 
evaluate, and you find some t^infes are really good, and would improve 
the school experience, help in the classroom., help the teacher do a 
'better job, how can you teed those changes and improvements **into your 
system year after year? This is our challenge. 

Most of these teachers, and all of the students are gone from 
/ our classrooms. We have a constant mobility factor. We need some 
means where the v^uable findings of tHis project can be steadily * 
fed into the ongoing operation so that' the teacher who comes in new 
this year wilX have a chance to leartk about it. The teacher who 
comes "^K^ two years from now, or^he principal, needs this information 
•^*but wJ have hot yeU developed the means* for doing this. We have very 
worthwhile findings now, and have lots of good things for teachers 
'to do in the classroom, bitt we don^t have the means for keeping alX 
this going. I haven ! t been able to'' get a research grant to look^^lrr^to 
this, and I don't know that I'd be successful if I had the grant, but 
I would. likjB to try. 

All of you who are ccTncerned #ith projects want them to be more 
' than just a good experience while they're being developed. You want 
" to really influence ongping social system^. We do too. I wish you 
would give some thought to it, and m^be we can share our thougtitN^ 
with Wyfiona, and come u^ with a working answer. " 
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[This will come up again In the Recommendationa Section. WSH.] 



Dr. Will Edgertcm, Peputy' airector of the Division of Mental 
health Services, North Carolina, (jame to coniment . About thirty years 



ago, He-sj^jLA* had »qi\ite a stint of work in a state mental hospital 

- ■ ■' ■• .'; - « „ _ 

^ ' ' ' . .... 

.. an<J^ 1^ yas really a snake pit. While we were working there we 

•"••"^v^ /-^^ ^ -i' - • ^ , V . ' V ' . • , ■> ^- 

.suc^eejded changing it ;^omewhat , and at, ^reatvpjjin. . That, eo^peri^hce 
led me to the point pf electing to work in vhat I call the preventive 
side of health affairs, this means that I have always belie'ved in 
preventive activities, and if you want to say it is a cult, so be it. 
I -believe that prevention can tak^. place' in the sphere' of emotional 
growth and development just as It can in othpr aspects of health. 
That i4eans, however^ « that the burden of proof is on us, so I*m very 
much in tune with what is happening here:. ^, * / 

'a' I^m glad Co see first of all ^hat we" have had-a sttldy that, 
^"'sh&wed spmethilig. There are findings that seent td^ be substantial . , 
and for real. ^However, in the face of all those negative thirigs we've 
be'en hearing, that people tried experimental designs out of wh,ich 
they got nothing "signif icant/!' it makes'us wonder if everybody is 
out of ste^ but Kansas City^. T'm sure that makes the people in 
Kansas City look everii moreyhard-nosed , and to <take a mdr^ hard?-nosed 



attitude toward tj|fter-4^^^they have than might otheriJise be necessary. 

' > : <- . ' •* . • ^ ■ . ■ ^ ' ^; . . 

I have pat td^ether a few impressions which I'lrf going ^^^J^^^ 

on you not iq any logical order, but kind of associations I've had as 

I We related to what has been going on. j; ^ 



-27- 



A very Imporcnnt thing, which haw been emphnHlzod HomewhaC 
alreodyC is that the projqct trained teachera an teachcrn. It / 
didn^t try to make something cloc out of teachers. It la very Impor- 

«tant to have done this within the educational context. It alao 

<» . ^ • . ■ 

linkad action for theae -teachers with detectloij, in the aame context. 
They dldn'it go about doing a screening thing and then taking some 
specific action as we might as therapists. It a good examj)l€f of 
'two organiratlbns with <fifferen$ missions, with" dltf ereht nfodes .^of ' 
operation, different values if ytKi like, collaborating very success- 
fully, Tliese are both very impottant integrated social systems, the 
health system and , the educational system and its refreshing to see , 
theCC tyo collaborate in this way successfully. 

I'm tempted Co tell you about some' things 'we 'ye been involved 

itt &lbng#thes(e lines, hut t viUM-ust mention thJftt the^ usual efforts 

• ■ * 

to evaluate this ^kind of project don' ts^ccope' out looking •^so well> It 
i# #6ry Very^Miff icuit to get datrf'\hat"will tell yea you've done ^ ' 
anything except maybe everybody has had a good time, Somfehow you 
^'kAow thar something mare than having a goo'd/time .ilyst have come out 
of this, but ^ere .again~ the rburden of fhe proof is on you. 

Another important thing about this i)roject I think/ and this 
has been tneatiohed *too, is that the project really was! excuted within 
the resources of personifel and time of the regu;ar scho6l system, 
Aiid that is not to say that more than a million dollar^ weren t 
spent on this project. But in terms of the amount of . time that 



'.V * 
* * . 

teacheyH and nchool atlmrnlfjCratorfi aiid'^HtuilenCn put Into It, I would 

'Again re.ltorVit^l that I boll^vo tliIfl*wou|d bo witl\(n tlie reach of 
• -v— * • • ^ . ■ . . ' • ' ^ 

jany »cliool jiyMtcm. These ^rv. fairly easy techniques to learn, * . 

Another a:4pect l»l tha^t It dealt with the 4)opulat Ion group from 

which mos^C,.of the problems co ge thl3, q^kiln, in, lilghly jjlgnlfl-- 

cant because people with the lowest Incomes, the lowest occupational 

' l^pycl th.«? least, amount- of educhtlon til general iire the ^roup from 

yhom most 'mei?ital dlsorlleVs come. This Is a lllrge group of people, 

our population surveys show, nnd so measures for siiccesfiTful fnCer^^ 

vent ion are going to have^ to be massive. 

I' would Itke to reiterate and upderlirfie what I hdVe heaYd today • 

about the diVficulMes in loAg .term research, because it is so 

difficult to Carry out long t«inn research. I was Involved -myself 

for some years on one particular project . ^ You get; tired of it. You 

: do., Yovi are very fortunate if you can keep the same staff throughout 1 

* . . ' ,f . - ^ , . ^ . . < 

the life of the project. And- there are funding changes. You con- 

• tinually have to find funds. Methods chAnge^ an^J-yo^ wish you had 

in the begi^uilj^ what develops later. ,1 congratulate the group here 

on being able to persevere. . . 

Two ,other things, I waot to meatlbn. Maybe this is an apology 

^\ ^ 

for us in this' field of inquiry. Maybe we haven* t be^ using, - 
haven't developed /fully the kinds of instruments thaic make sense for 
, doing eval-uation.j We use the best ones we have, and we create? some \ 
but it may T)(B that We don'^have the appropriate ones — sensitive 
enough to detect whatever <?hanges or effects result from our ac^on. 
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Anotlier aanoct ol thl^4, aiul I certainly coiiKraiulato chein on tUiw, , 

•/ . 

la auppoH« tlu?V luul •titopiu'il aCtor- tl^e flrHt t ow ytj^rH* they never 

' . — . , . : ^ 

wOt^ld^lijavi^^'dlMc^vercil all thoae cluingMi ^Over chat IwuRth of t^inc. 

Its Juat JUicky In ^Henue that they wvnt far enough to see 'Chat thlH 

happened over thlH many years. All Coo frequently wc give up after 

a certain time, whereas If wc had taken It some yeara furCher,vwc 

might have found very significant changes. 

Now. One question I might aak Is, 'What really httppencd In 

those . children?.' .If^J were to speculat^e for myself afeout what mav 

■ ^ ' . / ' '^"^ ^ ■ . • ' ' 

have happened In those children \/ho were Iflck^ enough to be In the 

experimental groups, I'd say these children had an oppprtunlty to 

develop some leadership skills, to participate In the decisions that 

had to do with learning and the activities In the classroom. This 

was tested somewhat, I believe, when Paul Bowman said some teachers 

' . ,■ » ' 

said these kj.ds know what to do and so they are easy to- teach. This,- 

t suspect, gives peopie and these children, a Reeling of autonomy which 

they might not h^ve had before. This certainly means the opportunity 

'to have more options about what one does; It means flexibility in 

choosing those options; It means more coping skills,- If you will, ; 

which must have cotne about as a result of this experiment. They must 

havef developed a sense of belonging, and, this Is very critical to 

normal and healthy development for all of. us. ' They must have had; a ^ 

sense of p,eer support, I'm quite sure, which sometimes we are not • 

apt to emphasize when we locus on the damages ancj destruction of peer 

pressure. 1 suspect 'that was part of it. I suspect they galn^ 
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tiom« neuttt? of « I t r 1 i.nuf alwi) whli'h thfy ral^^lit not havti nottrn In 
an ordinary i: lartriroura. Tlu'y were in unuill groiiprti nnd the dyiutmlrti 
of scdaI I Krtnipti certainl y ilo prov I ilc th 1 n . 

Another nspeit, I itilnk, of thlfi kind of project In that it 
doe8 help to make prevei^lon actlvltle« re-ipei:ted. And mayjt>e t\\ixt In 
whatjk I have been talking abou^ anyhow. -Wlien the mental health cent,er 
l«gl«laClon way pas?ied It m.imlatcil con.sultat Ion and education 

programs, and si^metlmea people equate prevention with conaultatlon and 

' . ■ \ 

education. It can be yo, but It may not. But this waa a mandated 

program which had to do with things other than purely pathology. There 

are two main strategies for prevention, primary prevention. One la 

to change "the environment, and _tl>*^thcr is to change the individual 

in relation to that efiv Ironmont . ^Prevention in our field can t Just 

be left to the clinicians. A lot of other people have to be 

Involved in prevention. 



[Remarks paraphrased by principal Investigator from notes made at 
Kansas University Medical School's Roots of Responsibility Workshop, 
Septembet 1974. Full texts to be available in Proceedings of the 
workshop at a later date.] ^ 

/ 
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STUDY MKTHUIH)|.()<':Y 

!• THE STUDY POrULATlON 

»lc datd for Che sCudy were recortlH of public vohuol 
pupllft collected and prrMrrved by th4 Creeter Kanaae City HonCal 
NealCh Foundation, Che InsC ICuCe^ f or CovnunlCy Scudlee #nd Che 
Board of EduceClon, lUneae ClCy Public Schools In conne^ccion wlch 
Cha Kansas ClCy School Behavior (YouCh DevelbpoenC > Projecc. The ^ 
current invesclgator became a senior assoclice of Che Mental Haelch 
Foundation NIMH Epidemiologic Field Station in 1970, as the 
original grants were expiring, and received the data anci t>frmlssioli 
CO further studies of the data at that tiaa* Xhe Foundaclon 

lac^r relinquished its Interest , and the study w«a* cont inued, by. the 
investigator through this granting period at the University of 
Kansas Medical Center in Kansas City. 

This report dcal.s with only one segment of the total number of 
racords compiled by earlier investigators: the records of children 
in the lowest (SES V) socio-economic group o^ the paretic project, 
from the first experimental year. . • 

The parent project involved^ one thousan4 four hundred pupl^Is in 
iCf first year, and another seven hundred ten in its second, final 
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.xperimeiital year. When we began the present study, three years of 
folWup' work hid 'been done on the first experimental year, and 
two the second.' Positive findings were emerging for one socio-. 
, economic grodp (SES V) from^that first experimental year. , . 

Three socio-econoiic st^rata of neighborhoods were included in . 
the parent project. These neighborhoods were rated on the «basis of 
d«a from a 1960 TOCA soclo-aconomic status map of the area by an , 
independent panel of' Judges who r«ad a number of relevant factors. 
p,^or to the experioeBt. " Ra^ were -hool ^nurses ,; visiting Z ' 
teachers- (Home School Coordinators) and members of the instructional 
' staff.' Ratings were used to match eW-imental and control classrooms 
whlfh were the 5«it.s of 'analysis in the early follow up. Teachers 
in the classrooms "were not made aware o, the ratings . Efforts were , 
^de^ to fill the top two strata of the Warner five level, system of 
ratings, but were- unsuccessful. Ss tor the three" strata of the 
first year parent project are as follows! 
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Total Number of Pupils 




s Lists 



for First Year YDP by SES Strata; 
, 'Dr,. Click' s. Analysis* ' 



-A 



4 



1 


/ 












SES 


N 


Boys 


Girls 


^ ■ 




















III 


493 


' ^31 


262 






















IV 


416 


1 221 


195 


'V 




V, 


■ ^ 495 


, 222 


























1404 


\ 674 


730 










s 













* Thesfe are real numbers, developed from 
* fenrollment lists of participating 
classrooms, parent prpject. ,^ 



A second experimental year, in which the first '^ear control . 
teachers became teachers in the experiment, was part o£, the parent, 
YPD i^ttJ^ject'. , The first year control served al control for ^oth 
experimental years^^^ so the second year involves only experimental 
classrtjoms whose teachers had served as controls the year before 
(making them their own cdn'trols) . The pupils in the experiment 
the.vSecond year were new 6th jgrade pupils. We have not '^1 lowed 
any of this group in t;he current study. 
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^ . Ns in the table aboveywere latsr-^jno.dif ied to exclude pupils 
who did not actually show up for clsWt^or did not com^tete the 
school yeai, but these Ns are not shown in Dr. Click' s, reports , 
because the classroom was bi^ unit of analysis. 



V 



Table II: Numbter pf Classrooms, 
Entire Yoath Development Project (both years) 
by SES Strata and Average Class Size: 
Dr. Click's Analysis. . 



total N 

28 

20 
• 26 



v -liumbe^r 'of Class rooms (YD?) 'c/^pi 
>1..N CAv. Size) 1 Exper 2. N. <Av.;Size) 



Exper. 1. .N CAv. Size) 
•6 (30.3) 
8 .(28.0) 
10 ^ (27'. 0) 



11 
6 

,8 



(29.7) 
'(28.7) 
(26.4) 



• THE, COHORT FOR OUR STUDY CONSISTS OF THE LOWEST SOcB-ECONOMIC 
GROUP FROM THE FIRST E5a>ERIMENTAL YEAR . OF T^JE. PARENT TOP PROJECT. 
This, lowest socio-economic group was part of the populatibn 

followed through ehree years of school after the first experimental 

r . . ' ^" 

year by Dr, Click of Community ^udies. His in^hpuse reports^ 

- Tsurimarized as Report //I for tMs grant) indicated consistent 
positive findings for this group at the end of *the three year period 
His findings were the major. reason our study was begun, and the 
rfeason it is limited td the 5th ,.socio-eco^K55iiG,.,grp<ip . No consistent 
differences were npted between the experimental groups and their . 

'controls in the other two SES ^categories. (Analysis of second year 
experiment data had npt yet approximated the. time covered in the / 
first, so we do not know* what that would have developed.). ' 

The total number of pupils in our cohort is 386. 

■ i;? • ■ ■ ■ 



BIAS .FROM LOSS . ; 

! ^ ' / 

Ten classrooms*^ v/ere included in the Experimental Group from 

SES V in the parent TOP the first year. These ten^classrooms 

\ ■ < ^ ■ 

contained 2A7 pupils by enrollment statistics (see, table preceeding) 

V ' - . . ■ ' . ■ ' ^ 

Thirty-^e of these children were lost during the , experimental year. 
No data was found for them in the years immediately, following the 
experiment. Twenty-two child-reh of Spani'sh-American and Mexican 
descent or identification w^. oiiiitted.-f rom the Experimental Group 
for our anjalysis. Good records Were available, but no Control 
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population existed in the parent YEtP data. (Race/ethnic identi- 
fica^tion was not us^d in the early analysis produced at th^ -» 
Institute for Community Studies, and as classrooms were^ the unit of 
analysis, i^obably could not h^e been). Data, and '^appropriate 
controls were available foi; the remaining 194. , ^ 
Eight classrooinsr were included in the 'Coi^trol Group fr^m SES 

vAn the pa.rent ifOP the'tirst year. ThesW eight classrooms 

■ - ' • J 

contained 212 participating pupils, twenty of whom were lost before 

the follow up years. Data are available for the rfemaiiling 192. 

This loss constitutes eleven per cent of the participant 

i . ' ■ ' 

\ ■ ' . \ 

population SES V, Year I Parent YDP, and less than ten per cent of 

r - 

the total enrolled population for this group reported -in Table I. 
The percentage loss for the Experimental Group is thirteen per 
cent, and for the Control nine per, cent. An additional five'per 
^cent of the participant population was omitted *from the study ^ 
deliberately because^iere was nc/ appropriate control population ^ 
for an important epidemiologic factor. 

If the loss figures are computed after omitti^ig the 22 children 
of Spanish-American or Mexican Descent, loss in the^ participant 
population is -twelve per cent, and eleven for ^h^enrolled popuia- 
tion. Percentage loss for the Experimental group is fourteen per, 
cent, and for the Control nine. 

' In most cases leks than .four', children 'were lost '-per^^classroom. 

" \ 

If four children had teen lost per classroom, our losses would total 
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72, con^^^^bly more than the 51 actually missing. 

*4. careful review of the circumstances by those familiar with 

th^ schools at the time of the first experimental year suggested no 

special reason for- the losses. A review of the- characteristics of 

the remaining' pupils does not suggest that they are spr&cial. - / 

Dr. Click's earlier work consistently failed,^to find classroom 

differences in the test variables. Stanfbrd Achievement test scotes 

* i 

from the fall of the first experimental year, SES V suggest that 
pupil ability was similar \for the pi^pils lost an| pupils in our 
cohort:- ' 

Table Stanford Achievement/Xest - 

Mean Scores, Year 1 Parent YDP SJS V Only, 
Comparing Pupils Lost and Pu^Jils Remaining^ 
in Current Follow Up Cohort 

■ / 

Mean Stanford Scores 







eriment 




^ . Control 






X 


a 


N 


X -a 


N 


Remaining • 


4.7 


1.2 


194 


4.4 1.6 


192 


Lost' 


4.4 


1.4 


31 


4.2 1.1 


20 



The total cohort for the following; analysis consists 
then of 386- school' children oh whom data are available: those who 
participated in the first year of ,the parent youth development 
project from SES V neighborhood elementary schools, minus those who 



were 1) lost by the first follow up year or 2) without ap^opriate 
epidemiologic controls. 



i 
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SEX DISTRIBUTION 
The i^attern of distribution of boys and girls is shown in the 
following table. 



Table IV.: Total Cohort for Follow Up 
Sixth Grade SES V Only, Year.l Parent YDP 
Percentaged for Sex Distribution + 





Experiment 


Control 


N 




Male 


52% 


41% 


178 


46% 


Femal e 


48% 


59% 


208 


54% 


V 


194 


. 192 


386 ' 


100% 



There are ei&ht per cent more girls (54%) than boys ^46%) in 
the cohorts This imbalance is reflected also in the Control group, 
where it is larger. The direction of the imbalancev is reversed in 
the Experimental Group, which has .04% more boys than girls. 

Sex identification was available in data received from earlier 
investigators, and was further verified by a random check, of student 
cumulative cards in the schools. '* 



■C 
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RACE/ET^^NIC DISTRIBUTION 
Racial/Ethnic differences are identified in th6 following 

c * 

Table. ' - 

• ■ -x 

* Table V: Total Cohort for Follow Up 

Sixth Grade"^, SES V Only, Year 1 Parent TOP 
Percentaged for Racial/Ethnic ^Distribution f 



R/E I.D. Experiment Control 

Black ' 79% . 96% 337 87% 

White ' 21% 04% . 049 13% 

- 194 , 192 386 '^00% 

* ' These figures represent a difference of seventy-four per cent, 

whicb indicates that the study population is overwhelmingly black, 

< . ■ » ■ ' • ■ 

This is true of both the* Experimental group and the Control, although 

there is a 17% dif f erence^^^t^eeT^ Our analysis, findings, 

and generalizing power will be largely restricted to black youth, 

a study okthe effect of the prograta on inner city blacks who live 

in loW socio-economic neighborhoods. 



Some analysis will^e done utilizing tfie non-black children, \ 
but thtf* small sample ^Ize, especially in the Control must be kept in 
mind. / - , , * A 

Racial/Ethn/c identification was gathered by previous investi- 
gators. Identification of children in thre6 categories 1) Negro, 



2) Caucasian and 3) Spanish or Mexican Surname. was made by clettedi:. 
personn/l in the public schools from -personal knowledge. ^" 

. ■ ^ . ■ - ■ ' ^ . ■ ? 

SOCIO-ECONOMIC STATUS' 

/ (A comment only; methodoLogy was described in opening 

^ / ■ ' ' ' ' . 

at4graphs of this chapter). The neighborhoods in the Youth Deyelop 

mcnt Project wer,e real neighborhoods', .Tiecogttized by Y^CA and school 

pfersonnefas^ having functional integrity , and the schools were real 

/neighborhood- schools, of the type recommended in the Report of the 

Joint Commission dn the* Mental Health of ^Children and Youth, (1970). 

Bussing had not begun. Urban Renewal had hot yet cut its way' into 

these inner city areas. Assignment by neighborhood, circa 1960, is. 

an on-the-avefage type of measure which> should provide for some 

similafities in socio-economic background between tWe Experiment ^ 

and ^the Control groups. It appearsv^o be a useful and realistic 

measure^ for the times, andit Is economical. ^ ^ ' 

' .B^sed on the elcperience of Dr.^Lee Robins, ^ in her landmark 

research following only male patients from a cHild study clin/g^ 

our experience at the Epidemiologic* Field Station in Kansaaf tity 

following mental patients, and the experience ot many others, the 

cost of developing new data on sbclo-economic variables at this late 

date seemed excessive (Robins,. 1969) . / 

' . / * )' ^ 

The pupils in the study weren\o longer in* tliB public schools 

' >. * ' 

In m^ny cases, being 18 to 20 yeargr old at the time this follow up 



grant .was ;sought. .It would have be^n necessary to find them and rely 
on^ their memories of their family incomes, o<?&upa;tions, etc., some 
eight years previously,, when ''thejr werd in sixth grade. We would^have 
then had to exclude more children from our cohort as we failed to find 
them for interviews, or as their memories were faulty, or as they might 
be unwilling to disclose what information they might have had — any - 
for, whom we could not have gotten adequate data for analysis', ^ 
Dr. Robins has pointed out that tracing young women is particularly 
difficult, and our 'cohort, unlike hers,;is over 50% female. 

Probability\?t>xtet%siv€^ losses in the study population and 
interview costs appear to excessive for the dubious increase in 
accuracy of matching on this variabl^e.^ This seems particularly ♦ 
true where *class ii^teractions are not at stake. Distinctions, if 
they could be made, would have to be made with a very fine scale. 
We are dealing, presuyiably with only one socio-economic class, and 
basically with one r;^cial/ethnic group within that class.' 



: ; PROBLEM BEHAVIOR DISTRIBUTION . ^ 

^ ' 1) Family Fil^fi- 
Early reports from Institute foj| C^mnrt^ Studies iitvestigatoi: 
Oren Click suggested 'that the cohort/ ^Aowed here might contain an 
.imbalance "in problem behavior, or more properly children whose behavior 
had been noted in th^ family files of the public schools, in that he 
found more of these children in th'e Experimental classrooms than in 
the Control^^l^ssrooms. . - 
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Early reports also m^ke clear the admonition that no one^ 
interfere with the regular assignment of children tip, classrooms at the 
opening of the school year the year the-^ experiment was to take place ♦ 

Itys not known whether^someohe, or several someone's, just couldn^t . 

jT \ ■ 

Resist the temptation to get special help for some children they felt 

V ' ' ^ ■ : • ' ^ • ■ 

wete in need, or whether -things' just turned out that way, but th^re is 
an /imbalance .favoring the control in the number pf children who have 
problem |ehavior records, in the family files prior to the exp^iment 

year. - 

Family file data 'for the period before the experiment was received 
from prfevious inves^tigators. The dajta we received was collected from 
the Pupil Services Department of the school system. Family Files are 
kept for children who are considered to have problems coping with the 
school env'ilronment . Early data and analysis was provided i^Nan edited 
version as our report 

' Family files contain information on the following, but only if 
serious (i.e., of ficiaip . action is taken: 



r 



Juvenile Court Referral 

Child Research Council Referral ^ 
Visiting Teacher Referral, • * ^ 

Pupil Servicesf Referral '""^ 
Home-School Coordinator Referral 
Other Referral 
^ Sfispension 

Special Withdrawal ^ 
Transfer to Corrective Institutions^ 
Welfare 
Truancy 
'^Tardiness - 

Miscellaneous ^ 
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. Not all children have Family Files; only those who have in 
some way exhibited coping difficulties which have required official 
notice arid action. The following table presents the imbalance 
noted, earlier in family file data. / 



\ 



Table VI: Total Cohoi^t 'for Follow Up 
Sixth Graiie Grade, SES V Only, Yeaf 1 Parent YDP 
Percentaged, for Family File Distribution + 
(3efore the Experiment) r 







* 








Experiment 


Control 


N 




Family File 


07Z 


01% 


18 


-05% 


No F^ily File 


93% 


99% 


378 


95% 




19A 


192 


386 


100% 



The Size of the difference is about 6.4%, where seven per cent 
is th/ maximum figure. The difference is important on that basis, 
bue basically^' because it is our outcome criterion. If the 
Experimental and Control groups are -not matched a^ the outset on the 



outcome criterion, care must be taken to allow for any imbalance in 
later' analysis, and in assessing the meaning of outcome statements. 
Note should be taken also that Ihe direction^f the imbalance 
faVTors the cGnt^rol. Positive outcome will n&t only requii;e less 
new problem behavior in the Experimental group, but working this 
group up out of the hole it was in at the outset. 



Addition of further data collected by our 'staff may shed light 
on this imbalance; * We collected complete records on the children in 
our cohort from the Kansas City Juvenile Court and from the Kansas 



City PomHI^ Department . 



Juvenile ^ourt records were examined l?y a member of our staff. * 



2) Juvenile Court Records 
nined l?^ 

The records are arranged alphabetlcal-ly by last name in two different 

•^sections: 1) Active files /children under 17 years of age; and 2) 

Inactive files, children 17 and older. Each file contains, a 

-> . ■ , ' ' ■ , ' " ■ 

description of the child, his family, any contacts with the court 

- or related agencies, and the outcome or disposition of these* contacts 

Our interest was? apart from verifying identity of the child, in the 

list of contacts and tjieir displasition. This information could be 

gathered from the face sheet, which listed referrals, and the inside 

cover of the file folder upon/which court orders, were noted. 

Identif^tcation was primarily by birthdate and name, where little 

school, data was available. 

Contacts involving problem behavior wer^ collected, and coded 

into cate'gories utilized by the police department. 

Part I offenses. 
. , Part II offenses . \ . 

Other 
, V^^Truancy 

.Traffic - ' . j 

. Probations 



Part I Offenses 

Burglary ( 
Shoplif tirjig 
Aggravated Assult 
Larceny! 
Robbery 
Auto Theft 
Armed R6bbery 



Fart II Offenses 

Destruction of Property, 
Carryirtga Concealed Weapon 
Creating a Pliblic Disturbance 
; Posessi'on oq Stolen Property 
Disorderly 

Solicitintt/for Prostitution 
Intoxica^on 



Other / 

Parole Violation . ^ ^ 

Juvenile Interrogation . ^ ^ . 

Incorrigible * \ 

Complaint Investigation 
Riding i-n a Stolen Car. 

Coding for both the Juvenile Court data and the Police Data 
was done by a research assistant experienced in handling data on 
juvenile court, traitting school and police^ data, Ms . Judith Walker. 



3) Police Data ' , 
Police data was entered on our class lists by police officers 
at l^QVarters. Our staff did not see the files there. We sent 
two class lists per week to the police captain in charge, and he , 
returned them to us week by week until the entire cohort had been 
worked "through l^is files. Dated lists of contacts and dispositions 
were made for each c^d^Tb had- a record in the police files. 
Identity was verified again by birthdate.. Police were helpful in 
finding and. identifying several o£ our co^hort who had not spent much 
of the follow up time in school and helped cut our loss of Ss to 
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a minimum by verifying a child's continued presence in Kansas City 
through his/her police record. 

■f" 

Again, only problem behavior was entered into our record for the 
analysis. One rhild had a record beginning shortly after birtih; her 
father kidnapped her from the hospital. That event was not entered 
in our analysis. 

Contacts were coded as; Part I Offenses, Part II Offenses, 

Other Of f ense^,^Truancy or Traffic Contacts, as before, and entered 

-if*' 

into our analysis by school year. Summer dates were assigned on a 
regular basis to the appropriate school year, so that a grade year 
runs from Septembirf 1 to the following August 31. 

^ A) SUMMARY: PROBLEM BEHAVIOR 
When data from all these sources is considered ,o the magnitude of 
the number of children in trouble (exhibiting problem behavior) is 
doubled. In the following table, each child is counted only onQe , 
whether he/she has a family file, a juvenile court recor^T, a police 
record or all three. " ^ 



Table- VII: Total Cohort for Follow Up 
Sixth Grade, SES V Only, Year 1 parent YDP 
Percenta^ed for Evidence of Problem Behavior 
Before the Experiment + 

..^^^ . - _ ■ ^ - • 

. § Experiment Control N 

Evidence . 11% 08% 37 10% 

No Evidence 89% 92% 349 90% 

194 192 / 386 100% 



The Unbalance between the Experimental and Control groups is 
diminished somewhat, but the difference is still there, and still 
favors the Control, daking the task of the program tougher than would 
be the case in a, carefully matched experiment. 

Consistent with^datajenerally the rate, for problem behavior 
favors the girls in the cohort. Our data does no^ appear to conform ' 
In terms of racial/ethnic differences however. The rate for white 
children is much larger than that for bls^cfcs^in the cohort (Eisner 19o9) 

Table VIII: Problem Behavior Prior to the Experiment 
All Sources of Information 
Rates Per Thousand at Risk 



Males 124. • 
?'emale8 72 




80 
204 



E;Lsner suggests black rates are generally Ih to 3 times as high 
as white rates, even in studies where data is. adjusted for geographical 
area, age, income and family structure, tt is possible that the; 
white children in 0ur cohort have special family structure, folkways 
apd mores, or economib problems of which we would not be aware. If 
so, the test is that much tougher in their^oase . .At the very least the 
labelling phenomenon described by nearly all researchers in the 



in -the delinqyency field, and made the special target of the 
National Strategy will have to be overcome on a larger scale In this 
group, to show program success (Hunter, 1973). < / 

On the whole, this imbalance in problem behavior rates makes the 
test for positive effect tougher, more conservative. Analyses will 
have to adjust appropriately for this initial difference in the two 
groups . 



,: ^ 



DROPPING OUT 



The comparability of the Experimental group^and the Control 
group in dropping out of school after the experf&ental year is also 
of importance. If they "are not comparable on this characteristic, 
outcome data Could be serioiii^y biased. 

• One factor which might lead an investigator to test for 
comparability is the previously noted disbalance in sex distribution 
in the two group ^, with males predomi;nating in the £xperiment^. Boys 
generally have higher dropout rates. 

Records of all pupils were examined for evidence of dropping 



out. 



Students were regarded as dropouts when they left the. school 
they were attending and there was no data to indicate return to any 
other school, and no data showing a transfer or withdrawal to some 
other school or school system. . , 

The following table presents the data on dropping out in the 

two study groups: 



"1 



I, 



\ 



58 



Table IX: Total Cohort £or Fpllow Up 
Sixth Grade, SES V Only, Year 1 Parent YDP 
Percentaged for Evidence 'of ^ Dropping Out of School 
After the Experimental Year 



Dropping Out 


Staying In 


N 


N^' 26% 


. 74% 


194 


20% 


80% 


192 


89 


297 


386 









E?cperimental Group 
(lontrol Group 



' Prior Variable? 
ISs^his difference (p=< .01) attributable to ^^e sex imbalance 
mentioned above, i.e., spurious in nature? T^ables IX and X present 
the data to test this notion. 

Table X: Total Cohort for Follow Up 

Sixth Grade, SES V Only, Year 1 Parent YDP-; 

• ,., ^ -'»'■■ 

Percentaged for Evidence -of Dropping Out. Aft^.r 
the Expetlmental Year, by Sex 



r 

Males 
females 



Dropping Out 
30% 
17% 
89 , 



Staying In 
70% 
83% 
297 



N 
178 
208 
386 



Males in our cohort do, as expected, have a higher rate of 
dropping out than females (p«<,01). The male rate is approximately 
300 per thousand at 'risk,' and. the female rate 170.' 



Table XI: Total Cohort for Follow ;Up 
^«th Grade, SES V Only, Year 1 Parent YDP 

Percentaged for Evidence of Droprping Out 
Partialled t6 Control ^or Sex Distribution 
and Differentia! Drppout R^te 4- I 



4^ 



V 

Exper 



Contrj^l 



ntS 



Mald^ Only ^ 
Dropping Out #6, Staying In 



33% 



rimeilt Rate '= 3^6 



-'^^ Control i^te « 260 



V 



> 7 . 



26% 

5 a 



67% 

7A% ^ 

12*5 



p>.05 



Experiment 



Control-. 



Females Oivly * * 
Dropping JDut" J Staying In 

80%^ 

> ... 

_ 8'5; 



/ 20% 

4 



/ 



36 



Experimental Rate 204 
Control Rate » 147 



172 <^ . 



N ^ 
>7 



178 



. I 



93t 



208 



By this line of reasoning, since the apparent association 
between tHe Experimental condition and Dropping jOyft disappears from 
^^^^statistical significance in bith portions of the tatvle, we accepted 
• the nirll hypothesis and regarded the Experimental group and Control 
groij^ as comparable. The original difference, noted in Table VIII, 
appears ta be primarily a spurious difference, largely a function of 
the higher dropout rate for males and the maldistribution of males 
in^phe two groups. . 

Intervening Variable 
There is, however, some continuing evidence in the" data that 
rates for dropping out may be somewhat greater in the Experimental 
group. Could this small difference rest on intervening variable such 
as schools attended after the experimental year? Perhaps there are 
different dropout rates in different junior and senior higl? Schools . 
If this is the case, and Experimental and Control group children do 
attend these schools differentially, later school may specify a 

condition under which the rates are higher or lower for the two 

* 

groups • 

: Aualysis reveal^ that 70%, of the children in the study went to 
either Lincoln Junior High and High School, or Central Junior and 
. High School. The remaining children went in small numbers to a 

variety of^other schools in the district. Tests of association with 
'variables of interest led us to. classify these otheff schools with 
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Central'as a single group of non-'Lincoln schools. Consecjuently ^ all 
school data' is presented in this collapsed format. ' . * . 

For instance, tests of statistical significance for the associa- 
tion between the Experimental/Control condition ai)d Juvenile Court 
records of problem behjjvior reach the .01 level of statistical 
significance for tables* separating children by later school attended. 
In these tests the Control yas high at Central High School, Manual 
j High School, Northeast High School and Westport High School. The 
Experimental group was high at Lincoln High School onljj^ Ns are 
small when the study population is broken up into specific (school 
categories* We felt that economy of expression, clari^ of presenta- 
tion, and the value of conservative testing was achieved best by 
combining the data. • " ' C 

No structural reason is apparent for the paths these stiklents 
took to later schools. As far as the school system is con-*emed, 
students from Che elementary schools in our study are as likely to 
attend Lincoln as Central. There is no official pattern. 



< 



Table XII: Jotal Cohort for Follow Up 
Sixth Grade/ SES V Only, Year 1 Parent YDP 
Percenttigeii for Evfdence of Attendance at Different 
Schools After the Experimental Year * 



Lincoln Other N 

^Experiment 14% 86% ^94 

Control ^ ' 47% 53% ' 192 

^ . % 118 268 386 

p-<.01 . ^ 

As shown in Table XI, children in the Experimental agd Control 
groups did not attend Lincoln, or Other schools in equal proportions. 
The Control group was more^ prominent at Lincoln, and the Experimental 
in the other schools. Of^course this time in the follow up, no 
at the^^hools would have known who they were. No records were 



kept, and thereby none were sent along with theift. The children were 
now three grade years separated from the experimental .year classroom 
and with a whole new group of teachers and administrators. 




Table XIII: Total Cohort for Fbllow Up ^ j 
Sixth Grade, SFS V Only, Year 1 Parent; YDP 
Percentaged for Evidence of Dropping Out at 
Later Schools 

Dropping Out Staying In N 

Lincoln , 18% 82Z 118 

Other 25Z 75Z 268 

, ' 89 297 386 

p-<.01 

The .dropout rate at Lincoln is 178, and the rate at Other scho( 

253. 

* ■ ■ ■ ' 

Table XIV: Total Cohort for Follow Up 
Sixth Grade, SES V Only, Year I Parent YDP 
Percentaged for Evidence of Dropping Out, 
Partialled to Control for Distfibution in Later Schools 
and Differential Dropout RateV 

* I • 

/ 

Lincoln Only 
Dropped Qui Stayed In N 

Experiment 25% ^ 75% ' 28 . 

Control li6% ^ 84% -25. 

• 21 97 118 

p«<.01 

The Dropout Rate for the Experiment is 250, and for the Contro 
155, suggesting that something is happening with the Experimental 
group children who went on to Lincoln, more than with the Controls. 
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Other Schools 
^ Dropped Out Stayed* In N 

Experiment ' 2 3X 7 7X 166 ^ 

Control ' * '28X; ' . 12% 102 

68-^ ' 200 ' 268 

'p->.05 ' / . \ 

Dropout rates for the Jixperiment and the Control at Other achoola 
are 23A and 284 respectively. 

Tests for partial associations in Table XII suggest a condition 
(attendance at Lincoln Schools) which affects the association between^ 
the experiment and dropping out. It should be noted that Experimental 
Group children dropped out more than their Controls when they attended 
Lincoln, but not if they went on to schools other than Lincoln. The 
rate for the Experiment at Lincoln is higher, whl|:e it is approxi- 
mately the same as that for the Control when children are attending 
other schools. 

Further inspection o^^the data suggests that it is possible that 
dropout rates for males are lower at Lincoln than at other schools, 
exclusive of experimental control conditions, while females rates 
vary by experimental-control condition differentially by schpol 
attended. 
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/ Dropout Ratofl for Ma lew 



Experiment » Lincoln 
Control » Lincoln 



240 . 
230 



For FeniiiU^M 
250 ' 

/ 

V90 



Experiment, Not Lincoln 350 / 170 

Control, Not Lincoln '370 300 

Both maizes and females have hlgheat rat^ at Other schools, if ^^^^.^^ 
they are in the Control Group, Males in the Experiment also have a 
higher rate at Other schools, but females in the Experiment have their 
highest rate at Lincoln, 



SUMMARY: DROPPING OUT 
Such differences as were noted in our f ifPqjfaropout table. 
Table VIII i were regarded as primarily an effed"fc^of the association 
of this variable with sex and the sex disbalance noted previously 
betJOfeen the experiment! I groups and tihe control group, A possible 

I ' 

secondary effect- from' the ncliools children attended after the 
experiment was also noted. 

The two groups, experimental and control were regarded as 
sufficiently comparable for further study. 

• Based on this experience with the data and the advice of our 



consultants decision was made to handle the data in further analyses 
in six study groups. 
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2. -n^K MIX STUDY cKour:; 



Once we were s.it i l.ul . tlut tlu* Control Rrotip and Kxprr Imcnt a I 
group were sufficiently comp^#able for analysU, we divided the HLudy 
population Into fitn nCudv groups to control nuijor sources of blaa for 
further comparisons . 

The study population was divided into groups which were homo- 
geneous for sex. race or ethnic Identification and schools attendiui 
after the, experimental year. This division resulted in six groups: 

1. WlUte Males, who went on to Other sch(5olthf rom the 
experimental year, labelled WMO. 

2. ftlack Males, who went on to Other Schools from the 
experimental year, labelled BM^. 

3. White Females, who went on, to Other Schools from the 
experimental ye^r , labelled WFO. 

4. Black Females, who went on to Other Schools^^rom the 
experimental year, labelled BFO. 

5. Black Mfeles, who went on to Lincoln from the experimental 
year, labelled BML. 

6. Black-Females, who went on to Lincoln from the experimental 
year, labelled BTL. 

These groups' were subdivided by the Experimental and Control 
cohdition to then produce six comparison or study groups for the 
analysis as follows: 

1. WMO Ex N-16 

< 

WMO C A 

I 



2. 


tSHi) 


i:x 






fiMO 


c 

(<; 




i. 


WKO 


2S 




WFO 


c 


4/» 


4. 


BKO 


Kx 


5^ 




BFO 


C 


•)0 


5. 


BML 


Kx 


l-i 




BMl. 


C 


]0 


6. 


BFL 


Ex 


14 




^BFL 


C 


60 



It should be noted that there are no whl^e study groups for 
Lincoln School. Nono of the white children In' the study attended 
Lincoln, so our comparisons there are for black children only. 

Devising study groups in this manner fshould contfori, ^r the 
effects or bias of variables which are ^t associated yith the 
experimental/control condition equally — sex, face or ethnic 
identification and school environment during the follow up. 

3. .DATA COLLECTION y 

/ ^-"^ --^y^ 

V Our cohort then consists of the entire first year SES V pop- 
ulatlon from the parent YDP including both experimental and control 
classrooms of children. TJne cohort is limited to those children 
who actually participated in the program. Pupils who were not 
present for the initial testing at the beginning of the program are 



not included, even if they were present for class later. Only tl\^e 
iChildren for whom we have records for the full period are included. 



\ 



Records from earlier investigators 



\ 



gra^e years, 



Records- received from earlier investigators included: 
nam^ of pupil 

classroom in experimental year 

Stanford Achievement test "scores from experimental year 
birth date 
sex 

race/ethnic group identification 
teacher ratings for seventh, eighth, and ninth 
public schools \ 'f ^ 

■ school absences for seventh, eighth and ninth grade years 
school family file data for K-9 inclusive 

master list of pupils in the parent YDP by. original class- 
room. Experiments and Controls. 



ASSEMBLING THE STUDY POPULATION LIST 



Our first task was to re-locate the pupils in the cohort. We - 

I 

used the,|laster List for SES V Year 1 of the parent YDP. ^ 

^Pupils oh-^^hFlist v^^' checked for participation in the initial 
testing at the beginning of^the program, and for participation in the 
school year the Experiment took place in the classroom of record. 

■ . ' ■^^^ ) ■ ' : ■ ^ 






pupils were not retained for t^e study population if both criteria 
were riot met. v 

Pupils vere then coded for racial/efhnic identification, as 

* * * ■ ^' 
noted in the section devoted to Racial/Ethni^ distribution earlier 

in this chapter. Children of Mexican-American or Spanish-American ^ 
descent were e;xcluded for the study population because all 22 were In 

the Master List. \ . - 

The list of pupils resulting from this ^f fort was submitted. to 
the Board of Education, Kansas City Missouri Schools f6r identification 
A run through their computers identified children currently in 
school" and located them in the proper school. This permitted us to 
go to the high school and search out the child's ctSli^ent Record. 
This list is referred to j^n our doctoments as List Fourtd in School. 
The Board of Education also fumished^us with a computer list of 
children not found in the school system. We searched for these 
children inithe schools 'ourselves, and in juvenile court, police and 

• \ ) ■ ° 

mental health center files. 

Data was needed to complet^ithe school records for two^ more 
years and to construct recct^^SgJ^or contacts with the 'juvenile court . 
•olice department and mental^health centers. 




X^kTk rkOM CUMULATIVE RECORD CARDS / 
<^ searfch was instituted fox the Cumulative R!ecord^Cata9 'of ■ 

i ) . • . ^ ' ' ■ • ^ , .1 

*pupljLs in our cohort. These cards contain record of absencrS^ and o^ 

■ " ' ' — '/ 

teacher ratings, and are located in the school currently att^^ed 

. /■ ' ' ■ ■ ■ 

by the child. 
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List of names not found in the school system. 

This list was also a print-out. from the School Board^. It 
contained the student number and original classroom number. The 
numbers were match^dXwith those from the original classroom lists 
to obtain names.- / 

If there was some original information on the child, the school 
which was last noted was used as the place to begin looking for the 
record. From that point the yellow transfer cards, which are filed 
alphabetically with the cum cards, were used to trace the movement. 
If, however, there was information given for the 63—64 year, and 
• a further loss of information during the 65-66 year, no follow up 
was done. In a few cases, there was family file information but no 
original cum card information. When this occurred we tried tracking 
down the complete cum card. > 

We checked through the original cum cards and if a hole was 
.found in the Personal Ratings during the original study this\/as 
picked up during the follow up. 

One group which presented a problem was the students who had ^ 
attended West Junior High. We consulted with Dr. Clyde Baer, of the 
Board of Education as to the most likely high school these children 
would attend. Since***bhey were listed on the "not founcf in school" 
list, we were not expecting to find many of them. Dr. Baer had a 
breakdown of a group of 84 fetudents who had attended West Junior 
High. The following list shows the disbursement of these 84 students: 



11 



Manual 
Northeast 
Westport 
Other 

Out of District 
Not located 



9 
18 
23 

2 
24 
_8 

84 



1^ 



From this example we saw that slightly more than one-half of the 

Students went to Westport, Manual, or Northeast and |fSi>st of the 

remaining group tran^fF^red out of the district or were\ not located. 

We concluded that i|^ would^e worthwhile "to check our lijst of West 

Junior High -students against the Westport, Manual, Northeast, and 

Archives files. If they were not located in one of those places we 

did not try to track them down any farther. 

»" 

Teacher Ratings 

Teacher ratings are the evaluative numerical statements class- 
room teachers record on report cards in the Kansas tity School 
District which reflect the teachers judgment about the pupil in 
four work categories: 1) work habits, 2) responsibility, 3) self- 
control, and 4) getting along with others. Each teacher rates each 
pupil from on a scale of five for each category. There may be more 
than one teacher rating the pupil each year. We recorded the mean 
rating, standard deviation and the number of raters for each work 
category for each pupil^or each year^^i These ratings are a normal 
part of ^ach child's school record . >^ethods replicated those of 
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earlier investigators, and completed some records which they ha<^ 
not been -able to complete. , ^. 

* ■ - ( - 



Absences 

Absences by school year are also recorded on the Cum Card. 
Absences are recorded as "days absent." If absence record was not 
complete for a given school year, the data was not included in our 
study. Only data for complete years was used. Absences were collected 
into weeks absent for our analysis, or expressed as average weeks 
absent. . ■ ^ ^ j 

Data collection methods, replicated those of earlier investigators 

t 

adding to records received from then. 

OTHER VARIABLES ^ ^ 

The Family Files 

/ 

Methods used in gathering data from the Family Files have been^ 
discussed at some Length in the .previous section devoted to that* 
data as a prior condition of our population. Both lists /(found and 
not found) of students were checked in the files. Forms f^ 
collecting the data were devised and^ere used in the data collection. 
Care was taken to represent an incident of problem behavior only once. 

Family File§ were arranged alphabetically at a central office. 

. • .-I ■ 

Juvenile Court Records and Police Ddta 
Please ref^r to earlier section dealing with this information. 



. /" Bo£h ll«B^v^ere also *rua through* the^ the Western 

l^iss'<iur^'^;ttenljki:Heltlth C^^^^ We^6rn Mls'sputl Is the current' 
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fom of the Fsychiatric ReceivinglGenter' developed °by the Greater 
Kansas City Mental Health FoundaMoft and operated under contcaciprtth 



the Cl€y of . Kansas City, Missouri, as a comprehensive connnunity mental 

£lth center. Its catc^ement area includes the^ neighborhoods 
^resented in our study. The facility has become the facility for 
the western th£^. of Missouri, in a state operated system of mental 
health services. It was thus regarded as the most likely (and only 
public) center for mental health services for our study population. 

The card file at Western Missouri is an alphabetical file of 
people who have been seen on any of the services. The card 'gives 
dates of visits or stays"\5id type of service given. Patients are , 
ldenti?fied by name, birthdate and address. 

We^-^have not Included mental health center data as evidence of 
problem behavior, where problem behavior has been'^reported as a _ 
phenomenon combining school, police and juvenile court problem v 
records. These last three sources of information are frequently 
utilized in discussions of juvenile delinquency. Contact with 
mental health services generally is omitted from that list. Our 
experience with the referral of children to Western Missouri is 
t^t where it is a result of school behavior problems, it app^rs 
in those records. Not enough is known about the nature of the 
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complaint to assign other contacts to this category; Data will be 
presented separately in the Findings section. 

Grade Year 

All data was organized by grade year , -defined as a calendar 
year from September 1 tp August 31 inclusive. After preliminary 
analysis, this variable was selected as the time statement , representing 
both the distance between rthe experimental year and the year the out- 
come measure represents, whether the child was in school, in school 
but out of phase, or in school and tracking. In this manner, attention 
can be focussed on approximate age of the chifd, and time elapsed 
since the experiment, which is thereby kept constant in the Comparisons. 

^ THE NEW MASTER LIST 

Finally a new Master List was constructed alphabetically, con- ^ 
taining all^l^^'^ildren in our study population, with ident ifyin g 
data f oar <tMsa\ to student records and original classroom 

in the ^y^^x^i^^ year, experimentali group and control. No child 
was included who 1) didiiot participate in initial testing, 2) did 
not complete the experimental year ins^he original classroom, 3) did 
not have at least two years of school data available and 4) could not 
be placed' in the city^ for the period of the follow up. 

Students were coded by student number, by original classroom, 
and by identifying numbers to permit cross'-ref erencing data gathered 
by previous investigators who used another system of numbers. Coding 
instructions were developed for all data, and data coded for IBM card . 
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f 
I 

/punching.. Cards were made and corrected for errors in coding or ^ 
\punchjng. Computer print outs were utilized in data analysis. Code, 
and card format attached. 

Raw data is stored under loctand Key under the personal super- 
vision of the investigator. Records have been kept in such a way as to 
permit any future investigators to build on our work. 

A statement should be made recognizing the professionalism of 
previous investigators, which Ve ^ave had many opportunities ,to 
appreciate. Records hSve been kept intact and were made intelligibly 
at the outset. Our follow up would have been Impossible otherwise. 
Relati'onships^with the schools etc., have been built carefully and 
well. We have had the benefit of this early work, afid trust we hlave 
continued in a similarly responsible manner. 

SUMMARY: DATA COLLECTION 
A cohort of three hundred eighty-six children was identified 
from the SES V, Year 1 parent YDP project for follow up. This. study 
population, or population at risk, consists pf children who partici- 
pated in an experimental sixth grade year in the Kansas City public ( 
schools, and their controls from that project. Demographic data, 
^d data for a three year follow up in the public schools was 
received from previous investigators. Replicating data for two ^ , 
more years of school follow up, and adding data for police? juvenile 
court, and mental health center services comprised the new. data 
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collected by this -investigator and staff. Old records were verified, 
and in some instances completed for the first follow up period, as 
well. 

■i 

Variables of interest are: 
experimental/control condition 
sex identification 

r 

race/ethnic identification 
outcome measures 
- ' grade year 

dropping out -c 

/ 

problem behavior 

familytfile entries ^ 

iuvenile court entries 

police contacts ^ 
school absences 
teacher ratings X ^^^^^ 

mentaV tieaUh;^^ ' . . 

4. tECHNlJpXDF STATISTICAL ANALYSIS: STRATEGIES 

Background 

Early analyses from the Institute for Community Studies dealth 
with the classroom as the unit of analysis, following the parent YDP 
study design. We chose the child as the appropriate unit of analysis, 
•particularly because t^e original classrooms were not functional 
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units after the experimental year children scattered in a seemingly 
random manner to a variety of junior highs and high s^ols. No class 
room group stayed intact in the follow up years. Our analysis of the 
comparability of the experimental and control- groups indicated that 
later classroom or school experience and environment might have 
infportant effects on outcome. Race also looked important. This 
dVcisiou was made at the Mental Health Foiffidal^on Epidemiologic Field 
Station, but our biostatistical consultants agreed when they came 
into the project after jit was moved to the KU Medical Center. 

Finally, after consultation with our longitudinal study con- 
sultant. Dr. Fhilip Enterline, we settled oji two concurrent procedures. 

1. Selection of a standard population or super control consisting 
of the pooled experimental and control groups; i.e., the 
standard or expected^ frequency is that of the average of the 
groups, which Dr. Euterline felt was ^e -most conservative 
test. 

2. Selection of the control grpup as the standard for the popu- 
lation at risk, against wh)^ the experiment should be 
measured', whic^ was regarded by our Biometr^ department 
faculty as the usual and proper process. 

3. Application of X specific rates to this (these) 
standard (s) . 

4. The Mantei-Hentzel goodness of fit, chi-square 
^ suvirvorship test introduces the time variable 
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for the longitudinal analysis, selected for this function 
by Dr. Enterline. 
5. Statistical signficances between ttie experimental and control 
(non-combined) groups were' determined by the use of an 
^xiant^n of chi-squared tests designed by Pearson to determine 
• signl^cance between age-adjusted death rates. 

We felt that while the pooled'^andard proposed by Dr. Enterline 
was more conservative, the use of the contf'bl aione for this purpose 
was sufficiently c<^n that we should show it as well. Use of the 



control alone will give other investigators, who might be unfamiliar 
with the pooled standard, a better feel for the size of the outcome 
figures, since, it will be more in line with their experie^. Tables 
etc.. are clearly marked as tp the base used. * 

Wherever possible and practical, both methods are utilized in 

this report. . . ' 

jjjjjl Strategy of Analysis 

A. Definition of the Problem (Reprise) 

The Kansas City School Behavior Project was intended to devise 
and test the effectiveness of a program of action for the 
treatment of mild behavioral disturbances in children in the 
school setting. The program was expected to prevent. 



to some extent, severe behavioral disturbances among these 

4 

children in the adolescent years, and to have an effect on 
behavior in the total communrty as well as in the school 
setting. T\tc design was executed^^^yithin the resources of 
personnel and time budget, of the regular school system. The 
project was intended to be a pilot demonstration a model f or ' 
other schools and communities. 

Early follow up of the pupils in the project indicated that 
there might be positive results three years if^ter the experiment 
took place. This pattern of differences was observed in referral 
suspensions, absence rates and teacher ratings. After six years 
of extensive effort, the pay-off appeared to be emerging from the 
mountain of data that had been gathered. We h^d to know if it 
was dependable, and whether it could be broadened to behavior 
outside th^ school system. We felt we had to know what tphe 
conditvfons were under which it worked or failed to work. 



B. Plkiufor Analysis and Evaluation » 

1, If the apparent prevention effect noted in the ninth grade 
year data can be shown to persist into the two following 
s(?hool> years; and, 

2, If -this apparent prevention effedt can be buttressed with 
data from outside the school system, giving it both 
greater credence and value; and. 



•SO 



3. If epidemiologic conditions can be specified under wh^ich 
the effect is valid, invalid or more or less pronounced;^ 
then , 

4. We can reasonably make recommendations for the design of 
future intervention efforts consistent with our findings 

V and our understanding of the relationships among the 
important factors delimited in our analysis* 
Our attempt to answer these questions took this form: 
C. Dat^(^llection 

1. Absence rates, teacher ratings. 

Family File entries for two further school years extending 
the time of the school follow lip to five years, oy^the 
eleventh grade year. 

2. Police records. Juvenile Court records and' Mental Health 
Center records for the entire life of each child in the 
study up to an including the eleventh grade year. 

Many other indicators might be used. Our concern was that: 
J 1. We dupli<;iate the earlier data on a longer time line. 

2. We utilize real life variables — records which are kept a 
an ordinary proces^ (and Ihot conjured up for our benefit) 
and are consequential in the lives of children in a 
community. 
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D. Methodology 

V. J In order to provide the most conservative answer to thes 
questions we have engaged in the following procedure: 

a) assume. i:he null hypothesis; 

b) piool the experimental and control group frequencies tA 
arrive at expected frequencies; and, 

c) compared the experimental condition with the (pooled) 
expected frequencies. ^ 

d) a standard experimental/control comparison characteristic 
by characteristic . 

e) compared each race X sex X school group (each of the ^ * 
six study groups) on each variable and graph the 
longitudinal changes. f 

V 

2. The two groups are comparable — the differences note^l in 
the charts should not be attributed to; 

a) Loss in follow up 

■ * \ ,i 

1, loss rate well within acceptable remits — less than 

10% over five years. 

2. Review of characteristics of remaining pupils does 
^ not suggest losses were any special grou^i. 

b) Dropping Chit ' v * 
No statistically sig diff E/C 

c) Social and Economic Factors 

1. Neighborhoods ^ell matched ' . ^ 

2. All children in one socio-economic class, no 
bussing etc, 

3. Stanford Binet Scores 

X within .3 — no^. big difference * 
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4. Behavior problem rates prior to sixth grade 



experience if anything favor c(|ntrol.i^^ w 
A final, analysis "Were Children in Trouble Helped?" .was addi^S" 
to deal with one of the goals of the pare^nt YDP; to help children ^ 



already in^^uble", ^ an alternative to expensive iV 
this analysis Xthe experiment and control groups have beert • 
pooled to estabMsh expected frequencies. A standi 



In 



•Sq^introl design was employed 



K 



» ft 



1 



J 



The Teachor RatiilfiJ^ / 
v^' The teachers rating is a ccAus < a -score (summed) developed from 
. numerical ^cores teachers give pupils on work habltsj getting along 
fc-. Wit;h^4^g||IP|,responsibility and self-control. Each characteristic 
I .,aay fajj^^Blfrom 1-5, so 20 would be a perfect score. Ratings may 

- be made by more than one teacher each year, and sometimes as many as 

■ /■'■•^ . . ■ ■ • 

f •*'feour-or five teacher^. Means of ratings for each of the four 

■;. ■ ■■'^ ■ • ■ • ■ ' ' 

oba^acteristics were summed to" produce a combined score for each 

^_ji|hlld year. 

"ItP DaCA begl^ Jlth the^seventh gra^e year, immediately after the 
', ■ ekperiment and /ontj^nue ' through the eleventh grade year. Most of the 
children were in schgltS other than the elementary schools where they 
>' were in the exper^ent by this time. Ratings 'shQuld , no^ be affected 
bv awareness by teachers that children had or had not been in- the 
exper^ental or control groups. No entrie^ were made in the ^cvlildren 
records, and there is little ' communication from school to schodl. 

An inspection of the* chart which* fellows indicates that if we 
had oJly seventh grade' year and eleventh grade year data we might 
conclude- a positive effect. However,' the -longitudinal view^oes not 
support this conclusion, , f^ the tenth grade year ^ • 

Figure. lA presents the data for the-^erimental group against 
the pooled standard for the population at risk. Figure IB presents • 
. . the^samtf experimental data^againse the simply, control-^staBdard . . 
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Both graphs Hhow the Experimental group with higher ratings 
iiranediately after the experimental -^intervention In sixth grade. 

Both graphs show the experiment slightly, better off at the ninth 
grade year and ttie final year of the follow up. 

Breaking the data down by schools attended after th^, siXth grade 
produces much learer pictures, and an explanation of \Aiat pro- , \ 
ducing the relatively flat effect, or, lack of -effect in ^he tial^]*^^^ 
Comparing only the experimental and< control, condition. "iTnesfe^M^t^ 
show a rather noticeable effect. 

Figure^ 2A shows the data with the pooled 
2B the dlatp with the regular control. Both fig^ 
ratings are consistently higher for t"he experimeii 
Schools, and lower at Lincoln. Size ofl the diff 

1 ^7 



experimental* an^control groug listings is smaller f oA'tj^hS^Xooled 

dir 



control, as we expected, but both graphs are ^lear a^fe|iiut\'' 

the differences. The. solid. line*ls (^yslstently ^d^^^ 'Vthar 
In one. set of Schools and consistently below at Lincoln.^ . , ^ 
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LINCOLN .SCHOOL 
Figure 3A (cont.) 




It appears ponslble Chat something In the environments at Lincoln 
•nd «t Other Schools Is related to teacher tarings. Something which 
works with the experimont at the Oth.r Schools, and" something which 
works against it at Lincoln. 

These findings might be even more marked In this difference if 
White Females at Qthfir Schools had not been rated consistently lower 
when they had been part of the experiment than when they had been in 
the Control. One can't help but be curious about what 'was happening. 

Findings for mmh of our six study groups are presented in 



Figures 3A. and 3B.' Figure 3A presents data compared "t^jthe pooled 

-1'.-' 'i-»v'^r 

standard, and 3B the regular control. . 

Inspection of the study group graphs suggests the finding of 

'positive effect for the Exp,erimental group at Cfther Schools is largely 

a result of ji^sitive ef f^ct ,for BlatV FemitUs and White Males at 

q|her Schools'. Black l^l.6s have generally higher ratings also, but 

this effect has disappeared anS reversed at the eleventh grade year. 

Reenforcement is probably in order at the tenth grade for many of 

these pupils, both Female and Male. % 

- •■ ■ 

As was, the case in comparing Figure, 2A and FSjfeifre 2B. the pooled 

standard gives a more conservative, but not a different picture of 
the results. 

On the whole then, we find positive effect for^three of ^ur four 
study groups who went on to. other schools', and negajiive effects for 
pupils who wjent on to Liticoln School. This specifies an epidemiologic 





condition under whlcl^ tl^e experiment tenJtt to work or not work — the 

school environment in the years following the experiment. Data also 

shows clearly how a positive result in one environment may cancel or 

NT 

be cancelled by a negative result' in another, in the over-all assess- 
ment (bf a program. Or results in peculiar findings only one 
environment is tested? We were for tunate that our study|^ population ^ 
attended, sereral^dif f erent schools, and that the environments 
apparently differed in ways important \to the success of this project. 

At tl[^is point w(i have shown data on one dimension, teacher 
ratings, which shows^that the prevention effect is present, and 
persists into the tenth and eleventh grade years ,^ and that it may 
be conditional to appropriate later school environments. The effect 
i9 ^linked to the experimental year in that it begins the following, 
or seventh grade year. There is no gap in the time order. , * 
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> The • Abai'nce Dntn 

Abscxi^o data has keen converted- from-^daya abflcnC, to average 
^ nuabat. of ab#dn4^'i|(c<5lL5-<or ' comparative purpoaca. Data begin wltli the 
.••♦•nth fradft year inmodlatcly after the cxparimcnt, and continue 
through the eleventh grade year. In the tJ^rk of earlier investigatora , 
and in the parent project design, absencca were regarded aa at least 
partially a reflection of dlaaatisf action with school, failui^e^to ac^pt 
a steady school role, ^ and generally a failure to work out a positive 
coping strategy for an important segment of a child's life. We (lave 
accepted that definition in regards to absences as problem behavior. 

One might also note that the schools define absences as problem / 

— i 

behavior, imposing sanctions in cases of excessive or unexcused 
absences. 

An inspection of the chart which follows Indicates that while 
Experimental and Control group absences are aibout the same in the ''^ 
year immediately Jafter the intervention year, by eighth grade a 
definite pattern has begun with Experimental group absences lower 
than the pooled controls These differences are stati^ically. sigtyi- 
^ ficant Jgr grade years nine andyj^n (Figure A). ' ;^ 

^Differences increase in size, but the pattern remains the same 
when the simple control . is utilized ift ,the chart in Flgute 5. ^ 

When absences are compared in our^ six study groups. Figure 6A, ' '--^ 

using the^ooled control, it is clear that most of the effectuated i n ' . 
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Figure A la a result of fewer absenceji among children In the 
Experimental group who are 1) black and 2) in Other Schools. 
Differences are in the proper direction In some of the other charts, 
but are not marked. Agai^, it appears that the Experimental "group 
children are better off When they go on to schools other than Lincoln, 
and it appears that reenf orcement of the intervention might have been 
useful about the time of the tenth grade year. 

As in the case -of the Teacher Ratings, it seems possible t;hat 
something in the environments at Linecj/n and at Other Schools Is 
different, ajpd- related to absence rates. Something which works with ^ 
the Experiment at the 0th6r Schools, and something which works either^ 
against it qrwith the control at Lincoln. , , 

When we use the stdndat'd control, in Figure 6B, differences are 
accentuated, and perhaps clearer. 



The abcienci' data iidilu n liirtln'r lUmtMiMlon to ^ugRCHt a prttvtMiCloii 

cffWt which pt)rslHt.s at least 'Into the tontli grade year, and which 

" ' 1 

may. be conditional to appropriate later school environment's, 

* V 



The Family File Data *" ^ 

^ The nature of the family fil^ data was described at some length 
/in our Methodology section, //I The ^tVidy Population, whLch discussed 
the compar'ability of the parent YDP SFS V experimental and control^ 
groups. The Kansas City MisVouri Family' file is a record of behavior 
problems in the schools which\made referral or other • documentation 
necessary. It includes suspensions, visiting .teacher referrals, 

^ 

referrals to other helping agencies — in shorty it is a 
system banging count. . 

Data consist of the number of behavior problems noted in the 



family files prior to the intervention year, and then the number^ of 
problems noted, class year by class year beginning with the inter- 
vention, or sixth grade yekr. *these problems would include any 
problem notation in any of t4iirteen content areas: 
Juvenile Court Referrals 

f 

Child Research Council Referral 
Visiting Teacher Referral | ^ 

Pupil Services Referral ( ^ 

Home School Coordinator Referral » 
Othec Referral ' 



Suaperitilon * \ i . 

'j 



SpcciaL WUhdr/]^waL . 
Tran^jf dr to Correctional 
WelXnre \ ' ^ . 

' Truancy 
Tardiness 

Miscellaneous. j 



Inatitui^lona, ^ ^ 



Gate was taken to make sure that only problems were coded into 
^ the record, and that each-problem was counted only onceV 

7 • ' ■ 

' An iixspecCion of the chart in Figure 7 will indicate positive 
effect for all years after Che experimental* year, except grade year 
eleven.- Both the tenth and eleventh grade differences afe statistically 
significant at the .05 level. Sixth, seventh, teig^hth and ninth grade 

•' Vl • 

year differences are In the^ peeper directioi^^but fail to reach thd 
significance level in this Qompari^n with the pooled control. The 
.reversal in direction during the /eleventh ^gfade year may indicate v * 

' ' i 

need for .reenforcement Sometime prior \p that point in time. 

• The^lf fierence in problem behavidfr^rioV to the experimental 
years is also statisticall/y sighificant, and favors Che control. This 
is the same finding, we described earlier in the Ffethodology isect^on, 
although it is produced via a different rqute of analysis. The report 
In the Methodology section was in terms of numbers of kids in trouble; 
while* this repor^t is made by number of problems. ^ In both c^es^ the 
cofitrol is in "better" shape at the outset of th* p^rient project-. 'The 
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FIGURE, 9B . 
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Figure 9A shows the farailW file data study group by study group, 

comparing the Experimental group data to the exp^ted frequencies 

• /' » ■ , . - 

developed by pooling the Experimental and Control group figures, 

Dr«- Click reported ^^rlier tfiat fie found a difference in these 
data favoring the Experimental^ group at the ninth grade year. ' Some 
evidence for this finding can be seen in thes^ Figures/ except for 
the Black Males at Other Schools — in five of the six^harts. Simi»lar 
differences shoW in the combined charts in Figures 7 and 8, tending 
tp Confirm his finding, although the pattern does not reac][i statistical 
significance, * 

Figure 9^ shows the same Experimental Group data compared with 
the Standard Control, 
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As before, in bhe other school based measures, the maih portion 
of the positive effect seei^ to be coging froiii Other -Schools, aiid , 
possibly from Black, pup irsjofe^* . - 

jlating^ to tl 



Further details relating*- 



•the final portion of th"!^; 
Helped?", whicli makes bef ore ana 



s Findings section, "Were Children iii. TrdubJ.e 



the Family File Data may be found in 



/ 



after comparisons. 



^ SUMMAR^ 
Dat^ presented so far suggest 



what cdnsistfeatly After t 
year. Dr. Click's ninth grade 



OF SCHOOL DATA - ^ 

that there .i« . indeed a measurable 



prevention effect for the experLment discernable in the school based ^ 
on information collected by' pre«^ious investigators. . Data suggest • 
positive effects J.mraediately after the e^Hrimetital year, and some- ; 

me iip ,%o the te^th or eleventh gtade ' 
^ear finding can be shown to,.>^^e^ 



continuing after that time, in the same order of data. Passible need 

.■■•V ■ ji^ ■ 

for reenf orcement seems to be indicated about grade year ^lev6n, as 
data suggest that the effect may be smaller, or even reversed by that 

Epidemiologic conditions have been suggested by the data, 
conditions under which the effect is valid, invalid, or^pore or less 
pronounced. Black" children who do not go to Lincoln^ School appear to 
have th^e^largest benefit from the experimental ye^^^, but White 
children who do not go to Lincoln School also show somfe positive 
effects, particularly Male White Children. Black Males also show 
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somewhat greater positive effects than Black Females generally. 

The majuor question remaining is," Can these findings be butteressed 
' with data from .the larger commtmity', or is this simply a schobl- 
related finding? 

We have suggested that the prevention effect does seem to -be real, 
that it persists^ into the tenth and sometimes eleventh grade years, 
and that it may be conditional to appropriate later school environments. 

The Juvepiile Court Data 
: ' The methods by which these datia were collected and categorized 
are described in our Methodology section. Data are sumn^ied in^hese 
charts as number of -recorded problems. Care was taken to assure a 
count of behavior problems only, excluding juvenile ^court .attention to 
"matters such, as custody , family problems, etc. There is some overlap 
of these dat^.wit^ those of the Family File, because referrals to 
Juvenile Court is* one of the thirteen content areas in the Family 
Files. Tj[ie data are by no means identical, of course since the \ 
iuvenile court has many sources other than the schools; fgr its contacts 
with children relating to problem behavior. \ * 

Data begin at birth, and* continue through the eleventh grade year. 

Data prior to the experimental year is. summed, as in previous counts 

J \ 
of problem behavior (See Family file Data). The data pridr to the 

■. ■<■- ' \ 

experimental year tend to corroborate the family file data which • 
suggest!»|d that the Experimental group was in more trouble prior to the 
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experimeXf than the Control, re-emphasizing the conservative nature 
ot the answer, particularly^^wher^ the pooled expected/ frequency is 
used as the test for 'difference or. effect. The data /also tend to 

. ; ■ ■ - I ^ ' 

corroborate the ninth/ gr^de year as significantly different from the 

sixth*, seventh and eighth grade years. It is at th^s point, in fact, 

' ■ ' ■ - /■ ■ . 

that: the ;Juvenile Court records show a positive effect for the 

' . * - . " / ■ • ^ . 

Experiment, an effect which continues after the ninth grade year; byt 

does not reach statistical sigfiif icance ^fter that time.* 

Figure 10, presents the numbei*^^ recorded behavior problems in 

the juvenile coUrt^iles for the Experimental Group compared with the 

pooled^ expected frequencies. The ninth grade year difference is r\ 

statis'^tically significant at the .05 level'. Differences for grade 

years ten and eleven are in the proper direction, but do not reach 

statistical significance.. Differences for grade years six, seven and 

eight are in the wrong direction, but mirtor the initial disparity in 

the two groups. The negative differences are not statistically' 

significant.. ' ^ ^ _ ^ 
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FIGURE-12B 
Juvenile fc^urC Data 
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■ / ' " POLICE DATA ' - - , 

• r .■• , ^ 

Methods utilized in* collecting and coding polic/e data are ^ 
d^scnibed in .the Methodology sfect'iori. '^' Police data consist of records 
of arrests and violations, collected for the entire cohort froip birth 
Co including the eleventh grajJe year. Records are summed as counts of 
behavior problems, year by year, with the exception of 'the period of 
time^ribr.to the experiment, which is handled ks one unit ^onsist^nt 
wltli our practise in other p.ort^ns of this report. 

figure 13 presenting data comparing frequencies of problem be- . 
haVlor ^tioted by the police department for the, Experimental Group to 
ppole(i expected' frequencies, indicates that statistically significant 
differences, appear in, t^e ninth, jcenth ^d eleventh grade data. X^^s^ 

differences Are in the proper direction. I 

^ ' . .. ■ ' ■ 

Police data tends to confirm the tiinth grade finding reported 
earliep by Dr. ^lick, and« to show continued effect, after that time 
even when we use our conservative measure to test the relationship. 

Figure lA shows the's^me 4ata tox the Experimental Group, * 
tested against the standard Control Groqp fifequencle^ 
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, Figures 15A and^ 15B show the 'PollM' data for the six study gro-ups; 

first in the A chart comparing Experimental to pooled expected ' \^ 

■. ' . • . ' • ■ \ 

fre<^uencles , and in B to the regular Control Group frequencies. 



/ 
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?1GURE 13 



POLICE DATA. 
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FIGURE 15A 
Police Data 
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Police Data 
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Police Data tend to: 1) confirm the ninth grade finding, 2) 
extefld that finding to grade years ten and eleven, and 3) serve to 
buttress the school data with similar findings from the larger community, 



SUMMARY RELATING COMMUNItV DATA To" SCHOOL DATA • r- 

School Data indicate a prjevention effect dating from the 
experimental year, demonstrated in Teacher Ratings, of work habits, 
4faking responsibility, getting along with others and self-control. 
By teacher estimate then, the experiment worked. Absences from 
school suggest that the students estimated a positive effect as well. 
Absence, rates" indicate a prevention effect in our largeLt study group 
in the Expetfimertt, (Group #2) immediately following th^^ experiment, 
and for the total group. by the following year. Differences reach 
statistical significance two years after th^ experipent , but the 
pattern is evident from the sixth grade on. ^jiamilv File data 
demonstrate prevention effects beginning ih the experimental year, 
and continuing through the four" years w^^ follow. The effect tends 
to disappear the fifth year of the follow-up, suggesting a need for 
reenforcement of the intervention about that time. School Data 
conf/rms)the report of a positive ninth grade finding, and extends 
that positive report back to the experimental year and forward into 
the tenth and eleventh grade years by most measures. 

Data are subjected to the most conservative test our consultants 
could recommend, and presented also in more typical fashion as a direct 



:er 



experimental/control comparison. They arc further tested against 
epldefi4Q,logic variables, cTiosen in early analysis of t^e cohort for 
comparability of the Experimental and Control groups. 

School Data also indicates that the prevention effect. may be 
pretty well confined to appropriate later school environments, and 
that it may have been dysfunctional frt^others. The positive effect^ 
for the Experimental group is often reversed at Lincoln School, 

Community Data also indicate a prevention effect which may date 
from the experimental year, although this effect is not as clear at 
that point In Vime as the Family File Data effect. Statistically 
significant differences in the Rrpper direction b^gin two years aft< 
the experiment, in the nihth grade year, in both Police and Juvenile 

>urt data, and continue into the tenth grade year in the Police Data, 
ihe pattern is clear throughout the Juvenile Court data ; the lines 
begin to converge after the experiment, cross about a year later, ^and 
then remain in proper' relationship to each other throughout the follov 
up period. Police Data present a very similar set of curves, but the 
positive effect seems to* wear off in the -final year of the folloy up, 
in that data. However, at the very least, Juvenile C ourt anH -Police . 
Data tend to 1) confirm the prevention effect, particularly the ninth 
grade finding, and. 2^ extension of the prevention effect into later 
years, 3) buttressing the School Data findings with f indings from 
social systems of the larger community. 

^ The preventio^ effect appears to be 1) real, 2) lasting, 3) 

ii \. ■ ■ 

g^eaeralizable to the iCommunity . ^ 
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The Mental Health Data \ ^ 

Western Missouri Mental Health Center is the 'designated 
community mental health ceoter for the geographical and political 
area of the neighborhoods involved in this follow up. The children 
In EhV cohort I'fved in Western Missouri !s- catchement area in Kansa9 

Styv i" Wl^'st^ttt" Missouri M^atal ;^t)e^^lthr Ceqter is filso the ,de<i ignited , 

r . • ^ .. ' » ^ • 

state bperjal^ed comunity mentW.. he'att^^^^^^^ for the westeBp m ' 

► * • 

third^ the State of MisseuW; whiC^^. includes Katv3|is Citj}.. 

search of the patient records at Western Missouri produced evidence 

that seven children front our cohort had sought mental health services 

or a rate of 18 per thousand at risk, over the 17 years of the follow 

up data. i;hree of these children we're in 'the Control, and four in 

t^. Experimental group. . . 

When the data on these mental health center visits is graphed 

coijparing the eoip^^^rimental condition with the pooled control as 

•■ ■ ^ ■ • - ^ .^v ^ ' y; - 

shown in Figure 16, there are more visits by children in the 
experiment in the t^enth grade year, and less at the eleverith grade ^ 
year th^n>might be exp*^cted. Figure 17, the standard experimental/^'^ 

control comparison indicates tl^e seventh grade year peak again; for 

^ ' . ' 

the contirbl, but ot;herwise very .mixed results. ^ . 

.W^ie^^e ^^andard experimental/control count .is broken down 

by la^er- School attended, as in Figure 18, the effects , of these 

later environments specify a conditional .outcome we haye noted '--^ 



• ■" . i 



beforej children in the Experimental group appear to be experiencing 
more stress at Lincoln » and the Control appears to be experiencing 
\mora stress at th^ Other Schools. .* 

Number are very small ,^n this soctj.on,pf the data. Note mightL^ 
not have been made at all» if the pattei^n of the data had not been' 
shown, earlier » In tdacher rat^ngci, absences ^^amily fil^e dacaf . ^ 
Juvienile cpurt and police records , Mnd. In tables showing combined 
trouble or system banging counts. 
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Figure Itl 
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^, WERE CHILDREN IN TROUBLE HELPED? 

X / . ■ 

'■' " r- ■ ^ ^^ . * ■ 

One of the goals of the Kansas City School Behavior Project 
was to prevent children already in trouble from engaging in 
further problem behavi^, through education in appropriate methods^ 
of social interaction. ^ 

b . . 

This goal is difficult to evaluate in terms of thejiotal 
project, bi&cause only one of the cohort comparison groups presents 
sufficient data for analysis. Group 2 (Black males ^o wei)it on to 
schools other than Lincolji)^ presents prob&em rates prior to the 
experimental year which are similar in both the experimental group 
and the control. Rates are approximately 50 children In trouble, 
per thousand 'at .risk. This group is also our largest study group 

(N«*114) , Ns are small in the other comparison groups available, 

' » *i ■ 

or there are no children in trouble in one half of the dyad. 



PROBLEM BEHAVIOR RATE^ PRIOR TO EJ^iBRIMENTAL YI 
FAMILY FILE DATA-^E 



Number In Trouble: ^^^^ p^^. j^^qq 
Comparison Group Number at Risk j^, Ri«Icx^* 

, WMOE 3M6 187 

mOC ..... ^:04 0 ' 



BMOE' . 4:70 " 57 

BMOC / ri^li 46 

/ • 

WFOE \ 3:25 . - ' 120 

WFOC 0:04 0 



BFOE ^ - 2:55 • ^3fe 

•BFOC 1:50 ■ m 20 

BMLE 0.14 * '0 

- ■ ' ' '" I .. ■ 

BMLC . 0 : 30 , , ' 0 

■ -'-St , . . 

BFLE - - 1:14 '7^ 

BPlfc 2:60 . 33 



droup 2 also presets mixed '^^i^JtQonia data. In that one measure 
suegests the control^may fare better than the experlineint. Teach§r 



ratings are slightly higher for Jthis control group , at the 11th 
grade year. All other measures show the experimental group to be 
In less trouble than would"' nave been ex^ecte^i* S&ch mixed findings 
flight IndjDcat^ that some of the early prpblem behiav^pr continued 
after the experimental sixth grade year. \. 

Infection of the data shows that four children ih this experl- 

/aental group of seventy children Jtiad family file records prior^^ 
the experlmepital year* Of these four, one child had no further 
record, and one no further record after sixth grade. Neither of the 
other; two children had records in the ninth, teiith or eleventh grade 
y^ts • By this measure then, all four were out^of trouble by the ^ 
ninth grade ye&r .> '• *V . ^ . * * 

V Two of these same four children also had a juvenile court 
recotd prior to the experiment. One >never 'repeated.^ The other had 
'a juvenile court record in the ninth and tenth grades, but no new * 




problems in th^ eleventh grade, year. l^None of^ the other sixty-six 

children in this group had a prior juvenile cour^ record. 

"f ' ■ , 

Three of the same four "children also had police records pi^tor 

^ > ' . 

tq the experiment;. • One had no new offenses after that time. One 
had two furtherfjoff^ses in .the 10th g^ade year, and^he third, had 
offenses in the 8th, 10th and 11th grade years. 

This search the cas,e« histo^ries. siiggest^ thaj><he rate increase 
in problem behavior from prior torthe experiment to the eleventh giSftie 
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CHILDREN IN TROJJBIE PRIOR TO EXPERIMENT: 
BLACK MALES, OTHEI^ SCHOOLS ONLY, EXPERIMENT 
ALL OFFENSES, FAMILY pLE BASE ^ 
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of 
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CHILDREN IN TROUBLE PRIOR TO EXPERIMENT: 
BLACK MALES, OTHER SCHOOLS ONLY, CONTROL 
' FAMILY FILE BASE 

, ^ * ''""all OFFENSES 



Number 
of 

C!^ldren 



4 - 

^ - 

2 - 

1 - 




(Prior) 



7 8 9 10 
Grade Ye^s 



11 



140 



year probably not a result o£ children In trouble continuing, 
or retuirnlng to trouble-making, but primarily a fungtltm of new 

children having trouble during the eleventh grade year, presumably 

' • • • - . #' . 

unable to cope with new stresses and perhaps needing reinforcement 

/ ■■ - ' 

of thA experimental year program. 

^ ' V ... _ ■ . ■ V ■ ^ 

- Relnforceiii^nt ml^ht be useful fdt all ^ these children., In the 
^ seventh grade immediately after the experimental year; there ver.e , 
no off^ses from tl^s group. 

•In the bontrol group of forty-four children, two had family 
file records prior to sixth grade. One continued to. have entries 
In the family file In grade years slx> seyen, eight, and nine. Th^ 
other had no further school record of problem behavior, but did 
make both juvenile court and the police recor4s In the sixth, ninth, 
tenth and eleventh grade years. The first pupil added juvenile 
court and police records to complete the 'p*icture for ninth, tenth 
and eleventh grade years/ Both pupils started out in trouble and 
were in trouble at the end of - our follow-up period, in contrast 
to the pupils in the experl^pent, only one of whom was in trouble 
at the close qf the follow ufi. period. 

%^ COMPARATIVE RATES FOR CHILDREN IN TROUBLE* 

PRIOR TO EXPERIMENT (BMO ONLY) 

.r 

ftatie Prior Rate at Close 

Group' to Experiment of Follow ^Up . 

Experiment ^ . I060 ' 250 

Control 1000 , 1000 

\ . 

*Children in trouble (BMO) only. N for children in trouble « 6. 



DELUJQUENCY RATES PRIOR TO EXPERIMENT 
FAMILY FILE DATA BASE 



Co]iq)arls on Group 
Total Study Populatioa 



Experiment 
Control 

Male 
Female 

' r 
Black 
. White 



Lincoln School 
Other Schools 



Actual 
18:386 - 
13:194 



5:192 



386 



9:178 



\v*386 



12:337 
6:049 



386 



3:118 
15:268 



386 



R^te per 1000 

26 

51 
43 

36 
122 

25 
56 



■ The data thus far are build on the same information base as 
early report? from this project detailing behavior problems, the 
family file of the Kansas Citv, Missouri public schools'. Rep- 
\ication of Dr. Click's data Jgd'thering methods for two further years 
of school data, plus" the addition of police and juvenile court data, 
perm^s the statement about conditions five 3rears after the ex- 
pcrlment for the children he noted had problems prior to project' 
intervention. / 

If ve take advantage of the conlplete juvenile and police 
records which were "^ded by our staffs we can make a ''more complete 
statement of the nature of 1) the problei as it existed prior to the 
experimental yeaF. and 2) the degree to which children with problems 
prior to the experiment were helped. 



i ' ..•/'''■ \ 
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DELINQUENCY RATES AT CLOSE OF 
FOLLOW UP (llt^ GRADE YEAR) 
COMPARED TO BASELINE RATES 



.r 



* 



Comparison Group 



Total Study Population 



Baseline 
Rate 

i 

88 



Follow Up 
Actual Rate 



69:386 



179 



Experiment 
.Control 




. 21 
13 



■19 . 
15 



31:194 
38:^' 

50:178 
19:208. 



160 
198 

i 

28Q 
91 



Black 
White 



24 
10 



62:337 
7:049 



1'84 
143 



Lincoln School 
OtHer Schools 




5 
29 



15:118 
54:268 



127 
201 



1 44 
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EsClmates of the magnitude or the degree of involvement of 
this cohort in behavior defined as problem behavior by-the\ 

r ' - . ■. . '." 

/community at large have to be revised upward, when information about 
juvenile court ^records and police records is added to thei^data base, 
In making the table which follows no child *wa3. counted in more than 
one category. Tha^ is';? if he had a family file' record and ;also a 
juvenile court record, he was only counted pi2(ce. Mental Health 



Center admissions were not included. 

V ' . . : .;, . • 

. Compir made by viewing the following table. 

Delinquency Rates Prior to^ Experiment , All Sources along side the ' ' 
Family , File based table just presented.. Rates are alfpiit doubled by 
adding this information. Rates f^ the Control are raised considerably 
more, from 26 per thousand population at risk to, 78.«. This relative 
^increase for the Control appears to be randomly spread through the 
ecologic dyads of the study population representing possible sex, 
rac^'and environmental diff^ences. The increase for the Control 
also helps to bring it in closer adjustment with th# Experlmei^tal 

group in t)ie number of children who were in trouble prior to the 

■ / . ") 

project intervention, although thfe Experimental gtoup still 

. ^ ,.. . . : . ■ 

contains the larger proportion of these children. • . 



1 
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DELINQUENCY RATES PRt6R TO EXPERIMENT 



ADL SOURCES 



Coqparlson Group 

) 

Total Study Population ^ 

Expet^ment . 
Control 



Actual 

37:386' 

22:194 
15:192 



Rate per 1000 



96 



113 
78 



.386 



Male 
Female 



Black 
White 



22:178 
15:208 



27:337 
10:049 



386 



124: 
72 

80 
204 



386 



Lincoln School 
Other Schools 



J 



v7 : 118 
30:268 



386 



59 

112 



If we return to our criterion group, the KLack males who , 
went to schools other than^Lincoln, and add this new informapion, n 
what happens? 

Problem behavior rates prior to the experimental year, based 
on all sources of data, are shown in the summary table, by the v • 
9afl^ six jjBtudy groups ye utilized early in this chapter. Comparing 
thjB rate for Group. 2, we discover that the rate is changed from S7 
to 114 for the "Experimental group, and from 46 to 18Z for the Control. 
We now show 8 children in trouble in the Experiment instead of A, 
and 8 in the Control instead of 2. * 



Of the elgh^t children in the Experimental group who werjp in 
trouble with either the school, the juvenile authorities or tY 



police prior to sixth grade, four had clean records in the final 



year of our follow up. Of those in* the control, a majority, six, 
were still in trouble. 

As shown in the two following tables, *the eight Control gfoup 

■ •# * ' 

children were all in trouble in two of, the follow up years, grade 
years eight and ten. The Experimental group shows a somewhat clearer 
and steadier decline over the years, with no year showing all 
eight still in trouble. V--^ • . 

Again, the reader should be reminded that the Prior figure is 
a cumulative one, and no value should be attached to the "apparent" ^ 
drop at sixth grade. ^ 
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CHILDlffeN IN TROUBLE PRIOR TO EXPERIMENT: 

♦ 

^LACK MALES, OTHER SCHOOLS ONLY, EXPERIMENTAL GROUP 
ALL -OFFENSES, ALL SOURCES 



8 

7 
6 
5 
4 
3 
2 
1 
0 




(prior) 6 7 8 9 10 11 



8 
7 

6 
5 
4 
3 
2 

1 

1 
0 



AS ABOVE CONTROL GROUP 



W— i. 




(Prior) 6 7 8 9 10 11' 
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COMPARATIVE RATES^'fOR 
* CHILDREN IN TROi/bLE • 
PRIOR TO EXPERIMENT (BMO ONLY) 
AI^ SOURCES 



Group 
Experiment 
Control 



Rate Prior tor Experiment 
1000 , 

• ^^^^ ,..-\ 



r 
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Summary 

A revised Delinquency Rate table, reflecting dataJrTpm all three 
vjf* sources of information on problem behavior exprfessed by children in 
the 3tudy OTior to and five years after the project experiment still 
suggests pdBltive findings for the experiment. The rate for the 
Experimental group increased from 113 to IBO.ywhile that of the Control 
increased from 78 to 198. If tfie same proportion of the Experimental 
group children were Ia trouble, in^jrelation to the^number in trouble 
af the outset of the study, as we flrid in the. Control, the* 
Experimental figure would be 287,, or nearly twice (179Z> as large. 

When we began with Family' File data only, the rat€:??or th^ ^ • 
Experiment was raised from 21 to 160^, while that of the Control was* 
raised from 13 to 198. On this basis, the final Experimental rate 
should be 319, or nearly twice (199Z) as large as we found. ^ 

The triangulation of the more nearly complete data collection 

■ . - •■ 
produces a slightly more conahervative answer, but the answer is 

ese entially the same. The final Experimental rate is far lower . 

than might haye been expected. 

If one were to apply the ^ost conservative test-, recommended 

by one of our consultants (see earlier description in Methodology) 

working froi^ the total data, pooling Control and Experimental 

frequencies aff^oiir "expectation, to produce new super control rate 

of 96 prloif^to the experiment and 179 as a final rate, the figure 

becomes 187%, again requiring an Experimental rate increase of 
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1 

nearly 200Z to suggest accepting the null hypothesis. 

If one could figure the rates without the Lincoln group, the 
spread between the Experimental and Control rates would be increased 

slightly. ^ S " 

Twenty two children were omitted from the analysis 'because there 
were no control groups to match them in their racial classification. 
If these children were added, the experimental outcome would be enhanced 
slightly in comparison with the control rate, as there' were five 
chllatBn in trouble prior to the project year and only two at final 
follow up. Rates would be adjusted as follows: 

N Rate 1 Rate 2 (Adjusted) 

Total Study Population 408 96 ^ 174 ^ . 

Experiment 216 120 153 

Control • 192 68 ■ °' 198 



9 
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DELINQUENCY RATES AT CLOSE OF 
FOLLOW UP (nth GRADE YEAR) 
COMPAJIED^TO BASELINE RATES 
AU. SOURCES 



Comparison Group • 


Baseline 
• Rate 


Follow Up 
Actual 'd 


late 


Total Study PopulatJ^ 


96 


69:386 


"179 


Experlmcsnt 


113 


31:194 


160 


Control 


78 


38:192 


198 


Male . 


124 


50:178 


280 


Female 


72 


19:208 


91 


Black 


80 


62:337^* 


184 


White 


204 


7:049 


143 



Lincoln School \ 59 15:118 127 

Other Schools \ 112 54:268 201 



ERIC 
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Ten per cent (N-37) of our study population was in trouble with 
either the schools, the juvenile court authorities, or the police 
when the project Uegan, Six years later, in the eleventh grade 
year, eighteen per cent of the 'population was in trouble* with .oi/ie 
or more, of these systems. 

At the outset, sixty per cent of the youngsters in trouble 
were in the experimental group. At grade eleven, forty-five per 
cent.' This finding suggests that children were being helped. The 
control had become the larger participant in problem behavior ♦ 

An intensive examination of the only epidemiologically 
comparable g^oup in the study to exhibit sufficient data prior to 
the intervention disclosed that children in the experimental group 
did in fact "improve." 

Half of these children improved, while only a fourth of the 

4 

tontrol portion improved. As can be seen in the following table, 
a further suggestion that children may have been helped can be 
dravm from the drop ±n absolute rates of problem behavixjr for white 
children in the experiment at other schools, and the failure of 
rate" for black females in the experiment at Lincoln to increase as 
it did for black males. • - 

Such increase as exists in the data then, appears to be a 
result of new children getting into trouble rather than of those in 
trouble continuing to be in trouble. 
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DELINQUENCY RATES AT CLOSE OF FOLLOW UP 
' (lltljL GRADE YEAR) COMPARED TO BASEblNE - 
RATES IN SIX STUDY GROUPS ALL SOURCES 



Group 



Prior 
Actual Race 



Follow Up 
Actual Rate 




1. WMOEx 
WMOC 



16 
4 



4 



250 
000 



188 
75\ 



2. 



3. 



BMOEx 
BMOC 

WFOEx 
WFOC 



70 
44 

25 
4 



8 

8 

6 
0 



114 
182 

240 
000 



19 
15 

1 
0 



271 
340 

40 
000 



4. 



BFOEx 
BFOC 



55 

50 



2 
2 



36 
40 



10 



55 
200 



5. 



6. 



BMLEx 
BMLC 

BFLEx 
BFLC 



14 
30 

14 
60 



1 
1 

1 

4 



71 
33 

71 
67 



4 

6 



286 



200 



71 
67 
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What Happened in the Later Schools? 

■ V 

/ (The reader would be well advised to re-read the final /paragraphs 
ok Dr. Edgertons remarks paraphrased from notes taken at the ROR / 
Workshop. We know that much of what he surmised actually happened, 
rom interviews with students reported by earlier investigators) • 



The children in th^s study, were in secondary schools from about 
^63-64 to 1968-69. They were tht "class of 1969." Those six years 
encompass' a lot of social change. Schopl integration, the Vietnam 
conflict, the assassinations of persons in high office and visibility 
including Martin Luther King and rioting in the streets and schools 
4^1 Impinged upon their lives and the lives ^ their teachers and 
parents. Social mobility borne of new ^mphasis on civil, rights affec 
all our cities during these years. 

The children in tfie experiment were being taught to participate 
in, to control in part, and certainly to cope with change. They were 
developing confidence in their ability to cope wii:li* change. 

A child with these skills, ^placed in an (ehrvirptppent in a state 
of flux, with turnover in administration, faculty and student body 
might do very well,^,,4md certainly might manage without banging into 
the system in any big way if he were motivated to succeed. Flexible, 
or disorganized environments might present assets. 

The same child, or another similar child with similar skills, 
placed in a traditional lock-step environment might well make waves, 
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ask questions, and generally create trouble Just doing what worked ^ 
in 6th grade. 

Children from the neighborhood, without the*special training for 

coping with dhange', might have a -lot -of trouble as their world shifted ^ 

^ ''i ' 

around them, repeatedly. It might be harder for them to Mgure out 

what was going on — todays solutions wouldn't work next week. These 

children .might , on the other hand be pretty comfortable^ where the 

^ . . .. ' ' 

rules were known, the head man wad a known quantity and history was 

» ' • \ ■ * ' ». 

some help. ^ • ' ^ 

Interviews with people famij-iar wlj:h Kansas City schools, 

'../particularly. wfth Lincoln and Central, whc^re most of the^children in 

#. the study went for secondax*y- education, describe n^'the schools a3 different 

r In sOmtf of these respects., . - '/ ' 

i . - < ^ . • . ■ ■ ' 

l S Central has be.en described a«',having a ^'good" academic image in 

/ the inner city — and as having jxearly all wliite students in 1960, 

L ' . , . ■ " ■ : , r , ■ v , ■ . ;• 

-\ ^ .. * ^ -., 

nearly all black by 1970. ^ Movements of more affluent and successful 

■■■ " - ■• ' ' • ■ ^ ' : / y. 

-*y4jliailie3 toward tlie suburbs helped tt^*' account for this. Families 
nearly^ll had to, buy ^h^m^is to move into the 'area Centrarl serVed. 

I ; ■ ■■■ " ^ ^ >J ' ' . 'r ■ 

> Teachefs and adihinlstratbrs moved in an4out of the .school. Central 
also h^d a reputation fpr an* admifil'3 1 rat icm which was flexi4)lVand 

people oriented. J^n any case. It certainly waft a. transitional phase. 

" . . ^ . ;^ . . ' • ' ^ ' ' : 

Tlie staff , remained- most'i|y whi^ite* durjlh^ thiOSi time,, wl^th turnover at 

,all le^iC L , \ / ^ . ^ • 

LinV^a^l^i.on ot|ter hand, |iad been ^^^l)l^ck for «so^^ time. 

• ■ vv^'-. ,. : " - ^ ' ' 

One '^admihistrator served Lincoln f or /near ly^AO years . ^Another spent 
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neA^iy all of tKe time of our fbllbw up as ptincipal. This stability 
of y^adership suggests solid traditional organization, possibly some- 
what hierarchical in nature, and probably w^ith a set of clear co^tant 
rules and re^gulations. A student* would know who was in charge, ^i^g ^ 
where he stood. 

Lincoln may have been, from bur accounts, more formal in organ- 
ization; Central more egalitarian. 

If our description is somewhere near accurate, and one mu^t realize 

the difficulty Irtvolved, the differences we found from the on^^chool 

i' 

settlng^to th^ other make sense* The stress would be greater for 
children from the experimental classrooms at Lincoln, and for^t^ 

control at Central: 

We have not been able to iwiitiuct a retrospective study of the 
school environments. We certainly have wished we could, or that the 
finding had surfaced In time to assess the effect on the spot, or that 
secondary school environments had been part of the parent project ^ 
design. 

If one had the resources, a study of disciplinary problems in 
the two schools might be possible, or a study of teacher conments on 
cumulative records. We would have to start, at minimum, with a random 
sample of the enrollments those years and track down the records 
pupil by pupil in central office files-. 

There is some indication in our informants reports that *all-black 
schools in the Kansas City Missouri system traditionally have been 
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more formal in style, traditional and somewhat lock-stepped in 
or^ani^tlon. If this is so, Lincoln may have been like that. 
Certainly there were a smaller nvj^ber of discipline and, other problems 
surfacing at Lincoln than at Central. If the rules are not clear, it 
may be easier to get into trouble, more referrals may have to be 
made. The ^'delinquency" rate at Lincoln, according to Family File 
Data, was less '*than half that of Central and th^ Other Schools prior 
to the experiment, and from all sources at the close of- the follow up 
127:201. - 

The literature isn't of much help, although a Kansas City 



investigator (Doll, 1969) identified administrative leadership in 
elementary schqcls as an important variable in problem oriented 
schools in the inner ciCy. A study of schools in Harlem (Clark, jjt968) 
also identified the principal as important in differentiating school 
environments. Polar types were described by Doll as 1) hierarchical, 
rigid, by-the~book, operating willingly within a closely structured 
bureaucracy and traditional cuatom and 2) personnel-oriented, flexible, 
less career oriented, attentive to local differences and needs, 
willing to buck the system. Some of these qualities may describe 
leaders in bur secondary schools as well. A classic study at the 

r 

International Harvester Company (Fleischman 1955) -pointed out the 
problems which can result when only a segment of the people In an 
organization a\e taught new ways of performing in their work roles • 
Similar forces/may well have been at work in certain of the later 
school environments. 
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DISCUSSION 

The Kansas City School Behavior Project was born of difficulties 
posed for the schools and society generally, by pupils who for one 
fieasqp or another did ijpt function successfully or satisfactorily 
with their fellow hyman beings. Efforts to solve these problems 
through clinical service arrangements with the Greater Kansas City 
Mental Health Foundation had proven that solution was inadequate^ the 
need^ It was literally impossible to give individual treatment to 
all children needing it. It was felt that any long range solution 
would require extensive effort to prevent such problems and prompte 
mental health, rather than treatment at a more serious stag«t^. Such 
efforts, it was thought, might best be expended on the development of 
certain classroom methods and techniques in which teachers could be 
trained. These methods and techniques would be aimed toward 
producing learning conditions in the classroom which might be more 
emotionally heal^ul for all children, and which might thereby 
prevent the mildly disturbed child from getting to be a more serious 
problem. Major emphasis of the training program, and hence the class- 
room experiment were interpersonal relationships with pupils and pupil- 
to-pupil, and the teacher as a group worker utilizing then new concepts 
in group dynamics and skill training in techniques of group management, 
utilizing sm^Al group interactdon in^the classroom. 

If successful, such a program might both reduce the need for help 
and increase the effective manpower ratio. 
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Behavior problems coaClnue to be a number one issue in the public 
schools, and in our communities. A recent survey of school personnel « 
personnel in children's agencies and in other helping professions 
rated behavior problems their prime concern (University of Kansas, 1973). 
Workshops, textbooks and consultants proliferate in this area. Every 
solution offered, with few exceptions, still demands individual 
treatment, whether behavior modification, reality therapy, medication ^ 
or other modalities prevail. Manpower still is far behind demand for 
services. 

Crime by children, some of it serious and commited by children not 
yet in their teens, is becoming a problem of growing concern to parents, 
police and school authorities across the country (Kansas City Times, 1971) 
Crime throughout the nation has increasea to the point that insecurity 
on our streets and ^n our homes jias been declared one of our foremost 
national problems. If official records are an adequate index, juvenile 
delinquency and crime are outracing our capacity to deal with them 
(Eisner, 1969). ^ ^ 

The Report of the Joint Commission on the Mental Health of 
Children and Youth suggested we have in our nation alone. 95,000,000 
children in need of remedial help. Current emphasis in federal and state 
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programs on the problcmn of children Indicate an acceptance of the 
priority of these needH. Every examltiatlon of health manpower Indicates 
that the need is far greater than can be met -with current conceptual 
and technical forraata which require highly trained individual treatment 
modalities. 

The problem in the schools seems 'to have grown substantially 
worse in the last few years. * Bicycle thefts increased in Los Angeles 
70Z over the "nine yearns from 1962 to 1971. Schools have increased 
•their security forces. Dade County had five men in 1968 and 98 men 
in 1971 only three years later. South' Boston schools are in the news 
today with stabbings and other violence. 

As our society has become more complex and individual expectations 
and pressures greater, the acquisition and exercise of social 6nd 
Interpersonal skills becomes more and more important in functioning in 
the everyday world. But what works? In a broad sense the teacher- 
training program which constituted the independent variable in the ^ 
Kansas City School Behavior Project represents a way in which the 
schools might more deliberately and explicitly attempt to meet their 
obligation in the area of the social-emotional development of children 
and youth. 

The Kansas City School Behavior Project is not new. It nay be 

unique. * 

In the early sixties James A. Davis of NORC was asked to review 
existing knowledge about experimental attempts at influencing 
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behavior- toward **p^wltlve m»*ntal hi^alth.*' Ilo ritported that while 

there WAS some' evidence that attitudes could be changed cxpcrlraentally, 

none of the experimcntH dealing with attempts to'chnnK<^ bohaxTior had 

poeltlve rcBulta (Davis, 1965). . 

Gene Stanforti and Albert Roark, in their 1974 book Human 

Interaction in Education remark on the ther^pei^t^ virtues of small 

group interaction in the classroom, but they^do so on an experiential 

basis. They cite no research to indlcat/ posit ive results in attempts 

to change behavior, or prevent or ameliorate behavior problems through 

its use. Conversation with Dr. Roark indicated that they did not find 

any. Roark and Stanford do point out that children do learn respect 

for others, careful listening, and that they learn to communicate 

unambiguously in group discussion. They suggest also that children 
f 

develop skills in group problem solving, MASain feelings of 
acceptance and belongir\g, which they ofteiftiS not learn in teacher- 
led discussions. They go so far as to say AS A LABORATORY FOR TEACHING 
STUDENTS TO GET ALONG Wlih OTHERS THE CLASSROOM DISCUSSION GROUP IS 
UNEQUALLED., The 'Cohpqivo nature of the classroom group coupled with 
norms that are similar to those in society in general, can, according 
to these authors, be a potent force in socializing the st\ident 
(Stanford and Roark, 197A) . It appears likely that that is Just what 
^9 was going on in the sixth grade classrooms of the Kansas City School 
Behavior Project experiment. 
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It aiBO Apptf^rtt likely that tlitr Kannaa City project with Ita 
apparent positives c^ffect in tho prcventCon of behavior diaordam, 
fuy well be a first, and thereby for the time being, an only. 

Because It la unique, we hav<\ nuidc every effort to be both co^ 
aervative and candid in our analysla. But we have not been able to 
make the positive finding go away. We have instead extended it» 
linked It In point of time to the experimental year, and buttressed it 
with data from the larger community. It Just will not disappear. Wo 
have specified epidemiologic conditions under which It la more or less 
proxlbjunced. ^ 

The value of demonstrating a solid evaluation of one such program 
should be clear. The feasibility of short course instruction In 
techniques of managing grorups and their utility in the classroom are 
given considerable Impetus. It ls|not unrealistic to expect that the 
program could be instituted at' modest cost by any urban school system 
with access to adequate teacher training facilities. 

The program also has significance in that 1^ departs from the 
usual emphasis on individual attention to children and school 
behavior problems and undertakes to train the teacher as a group 
worker, which is appropriate to het task. 

Finally, may have learned something about realistic program 
evaluation. Early follow up failed to show much in the way of either 
positive or negative results for two years after the experiment. 
Further data collection based on positive findings in the third year 
after the e^iperiment and an epidemiologic strategy for the longi* 



tudlnal ttUAlywU vKiiMulluK hoiU iUc Xtstxi^iU or i Imf ih« tttiul.-nin wnr 
followed 4iul clu* briNtdth of covrrrtK«, rtxiioo'l lo Juvifnlle Court 

«nd poilc« data ttnda to confirm tlni poult Ivcs nature of the orlnlnal 
finding.^ Lnttir anfllyn^ti aUo llnkt^d thu pofilclvw finding to the. 
•xparlmental year, dcmonutrated thtt continuation of thu poMltivc 
•ffact Into two further yearn of HChool behavior and buttrottord thett« 
flndlnga with almllar flndlngM from the juvrnllf court and police flU 
Long t«nn follow up, by ordinary standards, Ua^ bren ncccaaary to 
learn whether the experiment worked. It was also noceatiary to collect 
additional data from new sources, and to change the. strategy of tKe' 
analysis. None of this could have been clearly Indicated at the time 
of the early> follow up. Time for the children to experience further 
school environments was needed, and time for us to begin to see the 
effects of those environments on dropping out, before we became aware 
of a very Important Intervening ^ondlt Ion . 

Naturally not all of the behavior differences can be attributed 
to the one year experiment. Many other factors must have Implng^d^ 
on Che lives of these childti^n during the time of the follow up. 
We can only assume that they did^so in a somewhat random fashion, 
equally to the children In the dontrol and the experimental groups. 
The wonder is that such a small change for only one school year, and 
^ aa late as the sixth grade had any Impact at all. 



. . Dissemination 

In addition to less formal contacts vith many people who have 

t 

Inquired about. the project, several presentations have been made. 
An abstract was submitted to the World Congress of Sociology this year, 
and a paper was read at the* Midwest Sociological Society meetings " 
near the beginning of the grant period. 

A rather extensive presentation was made in September at the 

x4>t. ' ■ . 

, • >• /" 

University of Kansas Medical ■tenter Workshop, The Roots of . Responsi- 
bility: DesignsJ^r Solving Health Problems of Children and Youth IV. 
This presentation provided background, a descrip^on of t^e inter- . 
vention, presentation of findings and a discussion of significance and 
Implications by persons involved in various stage^ of the parent YDP 
project, the principal investigator in the grant study reported here, 
and a representative of the community mental health/prevention 
movement to an audience selected for its interest in child development, 
children's health and mental health. [This is a regonal workshQj^ 
held on an annual basis. We anticipate publishing a proceedings 
booklet of the type enclosed from lAst j^ar's works^^^^An agenda 
booklet for the meeting this year is also enclosed.] Jljtoy of these 
remarks are paraphrased in the Background and Significance section 
of^thi^ report. 

A seminar w±l^\xe presented later this year at the Medical 
Center for an interdisciplinary audience. 

Publication of Journal articles is anticipated. 



RECOMMENDATIONS 

The first recommendation suggested by our data is that teachers 
and school administrators, be encouraged to learn small gro^p - 
techniques if necessary and install them in the classroom if they have 
not already done so. Workshops should be sponsored by NIMH to motivate 
'and teach school personnel. \ 

If behavioral outcomes such as are reported here can result from 
one year of such te^hing, it is possible that implementation K-12 

would change the face of our problem, as it was outlined in the Report 

■% 

of the Joint Commission. 

Evaluation should be an important part of installing this 
program of teaching. Techniques such as^we have used are capable of 
application by school personnel. 

We are well aware that the positive finding is for only the 
lowest socio-economic group in the Kansas City experiment. We have 
not "^tempted any data collection or analysis of the material relating 
-to the othfer socip-economic groups. We do believe that positive 
findings might well be available if a follow up were to be made 
' similar to the one rSorted here. Early investigators, who reported 
no effect for t4»A*^theV groups, were, locked into a luriit of analysis 
which could easiW^ob^cure what happened dTx4 had onW^^ee yeaxs 
follow up data. Using the sixth grSde classroom as, a ynit of 
analysis fit some of the parent project design. " Th^i arid their time 
. line does not allow much flexibility for analysis y later environments 
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Further study of the effects of secondary school environments 
would be very useful. Certainly aay new experiments should build this 
into their evaluation research. Retrospective study of the Kansas 
City secondary schooj environments at Lincoln and Central would be 
necessary before we could make serious recommendations about the 
'most effective secondary school environments for reinforcing the 
press of the intervention. 

The best approach from our point of view is to start teachers 
utilizing these techniques where they are not already doing so, and 
evaluate further as we go. We, plan to mount a workshop for this 
purpose, and will ^e seeking funds. ^ 

If we were to proceed in the most scientific way, of course, we 

/ - . ' 

would first apply for funds to do the follow up, for the othej two 

groups and to analyze the secondary school environments and if* that 

p 

was successful, plan a tightly designed replication in selected 
cities,^ carefully analyze that, and then implement. • 

A more practical approach might be to operate on all these 
fevels concurrently, and might be practical if we could find the 
support. " * . 

What seems most, f easit)le in line with current funding realities, 
is to begin careful, evaluated implementation now. 

Any follow up work should be designed on a basis which can be ' 
maintained for at least five years, and incorporate studies of the 
later environments, if our experience is meaningful. One year 
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evaluations, or tests of attitudes before and after short course 
instruction did not work. Three year follow up was not long enough. 
Effects would have remained hidden if we had not taken .a longer time 
period and the later environments, into account. Thig pay mean that 
future NIMH grants, where behavioral outcomes are atistake, may need 
to require longer follow up than has been the practise up ^9^w^ time 
We would encourage the use of real-life variables and epidem&flogic 
strategies of analysis to assess these outcomes. <• 

If NIMH or HEW believes the findings to be worthwhile, we 
would like to sjee widespread dissemination of this report, or- an 
appropriate summary, ^ persons and organizations concerned about the 
health ^of children, problem behavior, juvenile delinquency, crime in 
the streets, child development, educational processes, social inter- 
action, evaluation of social action programs, epidemiology of mental 
health, orthopsychiatry etc. 
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Problems Encounter^^d \n the Follow Up 

Early on, our greatest problems had to do with tracing the 
chlJHren in the cohort. These probl^|^ relateU to the fact ^^^^^^ 

1) we had fairly limited idfentity material, since the earlier 
investigation concentrated on the classroom as the unit of analysis; 

2) children in the cohort sometimes changed their names informally, 
registering ip a different school under a different name; 3) school 
records were kept in the school attended, and each school had some- 
what unique record keeping habits; 4)'*^some data in the schools was not 
yet entered" in the childrehs f^les, and our assistant had Ito first 
post the records in order to acW them to our study data; 5) schools 

in the Kansas City system at that time were fairly aut onomo us, and 
therefore were each dealt with singly; 6) c^^;!^^®^ were also 
relatively autonomous in that they could attend pretty much which- 
ever school they wished, so that there was both a certain amount of 
mobility and a lack of patterning in terms of which junior high 
school you might expect a child from X elementary vschool to attend, 
making the search for records more difficult; all factors we were 
able to deal with successfully as discussed in the Methodology 
section of this report. We were, as a matter of fact, asked to 
consult with the school system about record keeping as a resjult of the 
successful effort in tracing these children. 

- Our research assistant was able to wotk in all the files ve 
needed data from, except those at the police department'. Another 




nembW of /the eld SXa^^ the^^polibe to make the 

Search ^tt^^elves. * ^ ' > ' , t; . ,^ ' ^ 
.iv Uiwe?:dijjl uot teproduce Dr. .GAiCk'"s a of variance.^ Our 

-statistical consultants didv Wot r^dnbmmend ;tha^ we do so. We had 
/anticipated that Dr.' Glitk w^iild be able to produce a flow chart jEor ^ 
. p^ograxmning his analysl^V-J^ut t?his:was not the case. Our only reason 
for proposing to do so was because the early finding had been 
produced by that method, and at that time we felt it was only fair 
and prop^-^ that any comment on whether that finding persisted be 
based on replicated processes. Our consultants were able to show 
us other procedures which did, as a matter of fact, produce a similar 
finding, extending it both by tying it to the experiment and taking 
it. forward over a longer period of time. 

Finding people who could describe the later school environments 
has been a problem. In several instances, people we really would ^-^ 
kive li"ked to interview had moved away, or died. The people we have 
found have been very gracious, but , generally had to refer us to 
someone else. Unlisted phone numbers, privacy, unwillingp^ssl^^^ie ' , 
quoted and other problems typical. of informants generally, hale 
intruded on our effort. We have made every effort to treat people 
fairly and sensitively in our data collection, and trust we have 
done so. Our remarks on this subject are a distillation of what we 
have been able to'lepm. , What we have been able to leai^ seemed to 
us to help explain some of our outcome data, and for thatj we are 
graceful. ' 
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The change in leadership and wind-down of the Field Station in 
Kansas City created other problems. Priorities changed and funding 
became a problem. Personnel changed- as well. Moving the project to 
KU and the grant solved most of those problems at that time. Center 
staff from Washington was most helpful, as were people here at KU. 
I was already getting biostatistical consultation here at KU, and that 
made the transition easier. It did take some time to shift to the 
new computers, etc. ^. . 

A new academic department may not be the^fesiest envixfonment for 
a principal investigator. Prcfblems of tooling up and other early 
organizational needs took time and energy and interfered somewhat. 
A personal illness did the same. 

More recently, a long hassle over equal pay for equal work 
required reorganization of our department resulting in the resigna^ 
tion of the first ^chairman, naming an acting chairman and an 
extensive departmental review. ^ . 

fJvA s>ipportive top administration, a very supportive new chairman, 
p^on from other members of our staff, resourceful research 
^^fr and a particularly fine secretarial "|roup has made 
verance, ^nd-'success possible. Cejiter staff has beeti most 
understanding and generous in allowing extensions to cope with these 
problems. A supportive family and interested colleagues make 
perseverance and success possible, with sanity. 
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